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ABSTRACT 

The knowledge that 17-year-old students in a local 
city school district had of literature and history was assessed using 
the same test items administered by the National Assessment of 
Educational Progress (NAEP) . A review of national results of the NAEP 
examinatio.i in 1986 has highlighted the gaps in knowledge of this age 
group. The Austin (Texas) Independent School District (AISD) assessed 
its students by administering 141 U.S. history and 121 literature 
items from the NA3P test to 960 high school students in the spring of 
1988. Most of the students tested were either 16 or 17 years old at 
the time of testing. Although problems with the representativeness of 
the AISD sample and the comparability of AISD and national sample 
place some limitations on the confidence of the statement, AISD 
students outperformed the national scunple after both descriptive and 
inferential analyses. Nationally, 60 of 141 questions were passed 
(answered correctly by at least 60% of tne students), while AISD 
students passed 86 history questions. In literature, 51 of 121 
questions were passed nationally, while AISD students passed 67 of 
121 questions. Even though Austin students did better than students 
nationally, the 61% passing rate in history and 60% passing rate in 
literature leuves plenty of room for improvement. Six figures give 
study data. Fourteen attachments present administrative cover 
letters, teacher checklists, and explanations used in the program; 
the test item rank order results; a list of test items; and NAEP 
objectives. (SLD) 
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WHAT OUR 17-YEAR-OLDS KNOW: ONE DISTRICT'S ASSESSMENT 



Introduction 

This paper presents the results of the only assessment (that 
we know of) by a local school district of its 17 -year-olds' 
knowledge of history and literature using the same test items 
administered by the National Assessment of Educational 
Progress (NAEP) • The results of the national assessment 
conducted in spring, 1986, using a seunple of 7,812 students 
were much publicized, and were even the subject of a best- 
selling book. What Do Our 17-Year-Olds Know? , by Diane 
Ravitch and Chester E. Finn, Jr. (Harper & Row, copyright 
1987) . In this book, the authors deplored the **serious gaps'* 
they found in students' basic knowledge of history and 
literature and issued a call for improving teaching and 
learning in these areas. 

In the Austin Independent School District (AISD) , Austin, 
Texas, the national furor over the apparently deplorable 
state of students' knowledge of history and literature became 
infused with an ongoing discussion about the amount of 
content being taught in AISD classrooms and the appropriate 
balance between skills and knowledge. Highlighted by the 
national debate, these concerns became a focus of attention 
by the Superintendent and administration in the 1987-88 
school year. 

The question was raised, "How does the District determine 
what the content of instruction ought to be?" Taking this 
question as a point of departure, the Office of Research and 
Evaluation (ORE) undertook a pilot study of the content in 
literature and American history curricula. The results of 
this study are the topic of this paper. 

Objectives of This Paper 

This paper will address four objectives: 

1. To describe a pilot study of the content of the 
American history and literature curricula in an urban 
school district, 

2. To present results from the District's administration 
of the NAEP items compared with the national results 
as reported in What Do Our 17-Year-Olds Know? , and 
results from local review of NAEP item specifications, 

3. To discuss problems encountered in carrying out 

the study, particularly local campus resistance, and 

4. To discuss directions for future study and 
implications for other school districts. 
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Data Sources 



The results reported in this paper derive from two sources: 
(1) the District's spring, 1988, administration to 960 high 
school students of the 141 U.S. history and 121 literature 
items used by the National Assessment of Educational Progress 
(NAEP) in spring, 1986, and (2) the rankings of NAEP item 
specifications for U.S. history and literature items by local 
reviewers. To honor an agreement with NAEP to maintain the 
security of its materials for future research, actual test 
items are not disclosed. District results are compared with 
the rational results using the same, disguised item 
descriptors used in What Do Our IV-Year-Olds 'Know? . 
Individual responses from reviewers are also protected. 

AISD's Study 

Origin of the Study 

In the fall of 1987, AISD's Superintendent broached the idea 
of administering the NAEP histori' and literature tests to 
some AISD students. At the tine, ORE was in the process of 
developing its research and evaluation agenda for 1987-88. 
The Superintendent's interest was therefore construed as a 
request for an addition to the agenda, and action was taken 
accordingly. An evaluation plan was drawn up which placed 
the testing in a framevork of an ongoing evaluation of the 
District's curricula, beginning with the content of the 
curriculum in U,S. history >u\d world literature courses. The 
selection of these curricular areas for study was justified 
by reference to the controversy about instruction in American 
history and literature engendered by the NAEP administration 
and the publication of results in What Do Our 17-'iear-01ds 
Know? Subsequent years' evaluations, to be based on the 
first-year study, were to be concerned with other curricular 
areas. This ambitious plan elicited favorable comment from 
the Superintendent and was adopted in November, 1987, as part 
of the official research and evaluation agenda for 1987-88 by 
AISD's Board of Trustees. 

Study Questions 

Four fundamental questions served as the franework around 
which the study of the content in the American history and 
literature curricula was organized: 

1. What are the important things that we should teach 
our children? 

2. Aro the important things in our curriculum? 

3. Are we teaching the important things to our children? 

4. Are children learning the important things? 

O 
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Evaluation Activities 



Evaluation activities were planned to address each of these 
questions. In the order of the questions, these Tfere: 

1. To have a group of persons with a stake in instruction 
in the District (teachers, instructional coordinators, 
subject area professors from area universities, etc.) 
review the item specifications from the National 
Assessment of Educational Progress and select those of 
greatest importance for the students of the District; 

2. To have instructional coordinators from elementary and 
Fecondary education review the Texas essential 
elements (mandated curriculum) , the scope and sequence 
of textbooks, and curriculum guides for evidence thtit 
the important content is included in the District's 
planned curriculum; 

3. To collect teachers' tests for analysis by 
instructional coordinators to ascertain what is being 
taught (on the assumption that what is being tested is 
being taught) ; and, 

4. To administer those items from the National Assessment 
earlier identified as measuring the important content 
in U.S. history and literature to the District's 
^^leventh graders so that their performance could be 
compared with the performance of students nationwide. 

At the conclusion of the 1987-88 school year, only the first 
end fourth of these activities were substantially completed . 
A sample of teachers' tests was collected, but their content 
has not been analyzed. The proposed review of the District's 
planned curriculum has not been implemented as of this 
writing. To date, owing to budget cuts and other 
administrative priorities, there is no plan to revive or 
continue the study. 

History and Literature Testing 

Although the student testing was originally conceived as 
occurring after review of the NAEP item specifications, 
as concerns about thd testing delayed getting the study 
underway and other activities encroached on the evaluation 
timeline, it became apparent that the testing had to proceed 
or risk not being conducted in the 1987-88 school year. 
Therefore, although it was logically out of sequence with the 
review of item specifications, it was decided to administer 
all of the history and literature items to the District's 
eleventh graders, rather than a subset of items judged by 
local reviewers to be most applicable to Austin students, as 
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originally planned, it was determined that the review of 
item specifications would occur either concurrent with or 
after the testing. 

Test Sample 

It was originally proposed that the history and literature 
tests be given to all of the District's eleventh graders. 
However, input from high school principals and administrators 
in Secondary Education prompted a revised plan in which one 
half of the District's eleventh graders would take the test, 
while the remainder of the students took the Social Studies* 
Test from the Tests of Achievement and Proficiency (TAP), an 
annual achievement test normally given to all high school 
students in the spring. An alternate, but not recommended, 
proposal had the students taking the history and literature 
tests in addition to the TAP. 

In a meeting with secondary principals held February 10, 
1988, the ground rules for the testing were finally 
established. The Superintendent was quite specific in his 
instructions to ORE: 

1. The testing of eleventh graders in history and 
literature would be voluntary for both schools and 
teachers, rather than mandatory as oriqinally 
proposed. 

2. A sample of students would be tested, but random 
selection would not be a concern . " 

3. Testing would be an in-house exercise conducted to 
obtain some information for examining the District's 
curriculum and to promote discussion about how much 
content was being taught and how much students were 
learning. 

4. The results were not to be published as in "official" 
ORE study, nor be released to the media. 

A memo was sent on February 29, 1988, to the 10 high school 
principals asking them to desianate a contact person with 
whom ORE could work out the details. Also, they were to send 
to ORE a detachable section of the memo documenting the 
number of students to be tested in history and/or literature 
and the date(s) of test administration. Follow-up calls were 
made by ORE staff to those campuses which did not submit 
written documentation. 
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Figure 1 depicts the participating schools, the number of 
tests administered in each subject area, and the test dates. 
Figure 2 tables the number and percent of tests administered 
in each area by the grade level, sex, age, and ethnicity of 
the students tested. The numbers of students taking one or 
the other or both test^ are shown in Figure 3. 

Seven of the 10 klSD high school campuses administered a 
total of 1,377 history and literature tests, 695 in history 
and 682 in literature. A total of 960 students were tested, 
with 4.3.4 . Most, but net all, of the students tested were 
eleventh graders (89.4% in history and 91.6% in literature). 
Most of the students tested were either 16 or 17 at the time 
of the testing. (Age was as of April 22, 1988, the date 
roughly at the midpoint of the time span covered by the 
testing.) Approximately equal percentages of boys and girls 
were tested. Almost two thirds of the students tested were 
White/Other. (Small percentages of Asian and Native American 
students were included in this category.) Approximately 
equal percentages of Black and Hispanic students were tested. 



Figure 1. FREQUENCY COUNT OF TESTS ADMINISTERED BY SCHOOL 
IN THE AISD HISTORY AND LITERATURE TESTING, 
SPRING, 1988 







NUMBER OF 




SCHOOL 


TEST 


STUDENTS 


TEST DATErS) 


Austin 


History 


137 


April 11 


Crockett 


History 


111 


April 22 




Literature 


110 


April 22 


Johnston 


History 


60 


April 5 




Literature 


191 


April 11-15 


LBJ 


History 


95 


May 12 




Literature 


99 


May 12 


McCallum 


History 


253 


May 12 




Literature 


245 


May 12 


Reagan 


History 


37 


May 11 




Literature 


37 


May 11 


Robbins 


History 


2 


April 4-8 




Literature 


0 


April 4-8 


TOTAL 


History 


695 






Literature 


682 








1,377 
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Figure 2. FREQUENCY COUNTS OF HISTORY AND LITERATURE 
TESTS ADMINISTERED, BY GRADE, SEX, AGE, 
AND ETHNICITY 



HISTORY LIT'^RATURE 

Number Percent Number Percent 

Grade 

Unknown 3 .4% 0 .0% 

9 2 .3% 1 .1% 

10 32 4.6% 33 4.8% 

11 621 89.4% 625 91.6% 

12 37 5.3% 23 3.4% 



1 


0.1% 


6 


0.9% 


249 


35.8% 


369 


53.1% 


61 


8.8% 


7 


1.0% 


2 


0.3% 


0 


0.0% 


695 


100.0% 


442 


63.6% 


129 


18.6% 


124 


17.8% 


695 


100.0% 



695 100.0% 682 100.0% 

Sex 

Male 351 50.5% 347 50.9% 

Female 344 49.5% 335 49.1% 



695 100.0% 682 100.0% 

Age 

14 1 0.1% 0 0.0% 

15 6 0.9% 5 0.7% 

16 249 35.8% 260 38.1% 

17 369 53.1% 370 54.3% 

18 61 8.8% 40 5.9% 

19 7 1.0% 6 0.9% 

20 2 0.3% 0 0.0% 

21 0 0.0% 1 0.1% 



682 100.0% 

Ethnicity 

441 64.7% 

Black 129 18.6% 120 17.6% 

Hispanic 124 17.8% 121 17.7% 

682 100.0% 



Figure 3. FREQUENCY COUNTS OF AISD STUDENTS TAKING 
THE HISTORY AND LITERATURE TESTS 

Number Percent 

History Only 278 29.0% 

Literature only 265 27.6% 

Both Tests 417 43.4% 

960 100.0% 
ERIC Page 6 9 
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Test It^ms 

AISD used the full compleinent of NAEP ite]as~262 knowledge 
questions, 141 In history aid 121 In literature. As received 
from NAEP, these questions were divided up among four books 
in each area, labeled: HI, H2, H3, H4 and LI, L2, L3, and 
Ii4« Each student tested received Irom 34-36 history 
questions and from 30-31 literature questions, depending on 
which booklets the student received. 

Test Time • 

Total time for a student administered both the U.S. history 
and literature tests was approximeitely 40 minutes. 

Testing Procedures and Materials 

During March and April, 1988, ORE staff drafted and prepared 
materials to be disseminated to the principal, the Building 
Test Coordinator (BTC) , teachers, and students prior to 
testing. This information's purpose was threefold: 

1. To obtain an agreement of security and confidentiality 
regarding the test items, 

2. To instruct select personnel on testing procedures so 
as to facilitate the process, and 

3. To provide basic information on the test and its 
objectives. 

Listed below, and included as Attachments 1 through 5 are: 

o Oath of Security and Confidentiality 

o BTC Checklist 

o Teacher Checklist 

o Taacher Fact Sheet 

o Student Fact Shaet 

These materials were sent to the campuses along with the 
designated number of presorted history and/or literature 
booklets and answer sheets. A standard, mark-sense answer 
document was adapted for use as an answer sheet. Where 
teachers names were furnished to ORE, student answer sheets 
were preslugged with stiidcsnt identifying information from 
central computer files. Attachments 6 and 7 are samples of 
preslugged history and literature answar sheets. 

Test Processing 

student answer sheets were scanned by District personnel 
using the District's IBM optical scanner. Computer programs 
were written by an ORE programmer to score the tests based on 
right/wrong information supplied by NAEP. 
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Test Results 



Test results were produced after the last tests were 
administered on May 12, 1988. Each campus received 
schoolwide . results by test area with items arranged in 
descending order according to the percentages of students 
nationwide who answered the item correctly. The number of 
students receiving the item, the number answering correctly, 
and the percentage of students answering it correctly were 
printed for each item. No individual or class results were 
created. Answer sheets returned without form numbers 
indicating the booklet number (e.g., HI, L2, etc.) could not 
be scored and were therefore excluded from the results. As a 
result, one school did net receive its test results. 

Representativeness of the AISD Sample 

A caveat is o'ffered before proceeding with the test results. 
It is not clear to what extent the students chosen by the 
schools to be tested were representative of AISD eleventh- 
grade students overall or how comparable the AISD students 
who were tested were to the students tested in the national 
assessment. As Figure 1 shows, a varying number of students 
were tested on each campus, one of the schools administered 
only the history test. One high school with 291 eleventh- 
grade students only administered the tests to about one 
class, other high schools tested most of their eleventh 
graders, e.g., McCallum High School. Three high schools, 
with a total of 1,098 eleventh graders, did not participate 
in the testing, !iowever. 

Figure 2 indicates that not all of the students tested were 
eleventh graders, nor were all of the students 17 years old 
As Figure 3 portrays, some students took only one of the 
tests, while other students took both tests. 

In terms of their demographic characteristics, the AISD 
students who were tested (mostly eleventh graders) were 
similar to AISD eleventh graders at the time of the testing. 
There were approximately equal percentages of males and 
females in both the test sample and the general population. 
Most of the students tested (90.7%) and most of the AISD 
eleventh graders (84.8%) were 16 or 17 years old. There were 
slightly greater percentages of White/Other students (+6.8%) 
and slightly fewer Hispanic students (-5.2%) in the test 
sample than in the population of eleventh graders overall. 

In comparison with the national sample, some AISD students 
were older and some younger than tlie 17 -year-olds tested 
nationally. Some AISD students were in lower grades than 
grade 11, and some were in grade 12. Distribution by gender 
was about the same. See Figure 2. However, AISD tested a 
smaller percentage of White/Other stuc .nts than was tested 
nationally, 64.1 to 82.2, and a larger percentage both of 
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Black and Hispanic students — 18.1% versus 12.9% and 17.8% 
versus 5.9%, respectively, if lower achievement is 
associated with the presence of minority test takers, then 
other things being equal, the greater representation of 
minority students in AISD's sample than in the national 
sample would argue that the performance of AISD students 
should be worse than that nationally. This was not the case 
as will be discussed in the next section. 

While it is. not possible to say with any certainty uhat the 
AISD students tested were representative of eleventh grader::; 
as a whole,, the test sample did not appear to be greatly 
. different from the general population of AISD eleventh 
graders, at least in terms of demographic characteristics. 
The nonparticipating high schools did not have materially 
different student bodies than the participating schools, nor, 
despite the researchers' fears, were^ there any indications 
that local campus personnel selected solely honors students 
or the like to be tested. Therefore, it may be reasonable to 
assume that the AISD students testrd, while not randomly 
selected, may have been fairly representative of AISD 
eleventh graders. 

Comparability with the national sample is less clear. The 
demographic comparison with the national sample has already 
been discussed. Special education students were prooably 
excluded in the AISD administration, but NAEP guidelines 
afforded ample opportunity for schools to exclude special 
education students from the national administration. In the 
future, if resources become available, it will be possible to 
examine the AISD sample to determine if it is representative 
and comparable to the national sample. 

With these cautions and qualifications expressed, it may 
nonetheless be instructive to form some impressions of the 
results. 



AISD's results are j»resented ir Attachment 8. Attachment 8 
is a rank-order listing by test area of AISD results arranged 
in descending order according to the percentages of 
students nationwide who answered the item correctly. The 
national results are reproduced in Attachment 9. 

AISD Percen t Correct and National Percent Correct 

There are many ways in which the results could be analyzed. 
One way is by comparing the AISD'i; percentage correct on each 
item with the percentage correct obtained by students 
nationally. For comparison purposes, we adopt as a 
standard the scale used by Ravitch and Finn in which a score 



Wliat AISD Students Know 



Comparison of AISD and National Results 




of 100 is "perfect,** scores between 80 and 100 are treated as 
if they were A'a and B's, scores between 60 and 80 as C's and 
D's, and below 60 is taken as a failing mark. 

History . On their scale, Havitch &:id Finn found among 
students nationwide that 15 (juestions were answered correctly 
by 80% or more of the students, an additional 45 quesrions 
were answered corroctly by from 60% to 80% of the students, 
and 81 questions were answered correctly by fewer than 60% of 
the students. This means that 60 of 141 cmestions (42.6%) 
were "passed" (answered correctly by at least 60% of the 
students) , while 81 questions (57.4%) werra "f ailed." 

By comparison, in AISD, 29 questions were answered correctly 
by 80% or more of the students, 57 additional questions were 
answered correctly by from 60% to 80% of the students, and 55 
questions were answered correctly by fewer than 60% of the 
students. In other words, 86 of 141 questions (61.0%) were 
'passed," while 55 question!* (39.0%) were "failed." 

On what kinds of history questions dii AISD students do best 
and worst? A great deal of attention was paid to the 
inability of most students to place the Civil War in the 
correct half-centur/. In the national sample, only 32.2% of 
the students could do ''o correctly; in AISD, only a sl'.ghtly 
greatei: 40.1% answered the question correctly. The lowest 
score dealing with chronology obtained by the students tested 
nationally in 1986 involved placing Abraham Lincoln's 
presidential term in its proper twenty-year period (1860 to 
1880). Only 24.7% of the students tested nationally made the 
correct placement; even fewer AISD students (20.2%) could do 
so two years later in 1988. 

In the knowledge area of maps and geography, 92.1% of the 
students in the national sample could identify the Soviet 
Union on a map of Europe; 96.5% of AISD students could do so 
(the highest percentage correct for any history question) . 
On questions relating to the U.S. Constitution and its 
antecedents, 30.6% of the students in the national sample 
correctly identified thd Magna Carta, while 33.5% of AT"D 
students did so. Regarding women in history, 83.8% of 
students nationwide knew that Harriet Tubman helped slaves 
escape; a similar 86.6% of AISD students knew of her role. 
Op questions dealing with more recent events. Sputnik was 
recognized by 62.7% of the students in the national sample 
and by 77.3% of the AISD students tested. Only 53.9% of 
students nationally could correctly depict the American role 
in Korea, compared with 66.5% of AISD students. In the area 
of civil ri'^hts, only 55.5% of students nationally accurately 
described tlie Brown decision. An "adequate" (to use 
Ravitch's and Finn's term) 74.1% of AISD students recognized 
its significance. 



Page 10 



Literature , On the literature assessment, nationally, 
14 of the 121 questions were answered correctly by 80% or 
more of the students, 37 more questions were answered 
correctly by from 60% to 80% of the students, and 70 
questions were answered correctly by fewer than 60% of the 
stuaents. Using the same scale as for history, this means 
that 51 of 121 guestions (42.1%) were '•passed*' (answered 
correctly by at least 60% of the students) , while 70 
guestions f57.9%) were ''failed.'* 

By comparison, in AISD, 22 qi^estions were answered correctly 
by 80% or more of the studenvj, *45 additional questions were 
answered correctly by from^ 60% to 80% of the students, and 54 
questions were answered correctly by fewer than 60% of the 
students. In other words, 67 of 121 questions (55.4^) were 
"passed^" while 54 questions (44.6%) were "failed." 

Comparing individual items, among students nationwide, less 
than 20 percent could associate each of these authors with 
their most prominent works: de Tocqueville (15.5%), Joyce 
(15.6%), Dost-^oevslcy (17.0%), Ellison (18.3%), and Conrad 
(19.3%). Recognition among AISD students of the same authors 
and their works was 26.4%, 17.9%, 30.9%, 30.9%, and 26.1%, 
respectively » Nationally, 57.0% of the students Icnew that 
Shakespeare %rrote sonnets as well as plays; 76.5% of AISO 
students knew this fact. 

Among questions related to the Bible, 61.0% of students in 
the national sample and 60.4% of AISD eleventh graders knew 
that King Solomon was renowned for his wisdom. On questions 
about Greek mythology, 45.4% of students nationwide correctly 
attributed the start of the Trojan War to the abduction of 
Helen; 54.5% of AISD students identified the cause of the 
war. On questions related to epic literature, only 36.1% of 
the 17-year-olds in the national sample identified Geoffrey 
Chaucer as the author of The Canterbury Tales. ' A still- 
unacceptable 45.8% of AISD students identified the author. 

On items concerning well-known passages and quotations, 88.1% 
of students in the nation recognized Martin Lurher King, 
Jr.'s **I have a dream,** the fourth highest score on the 
entire literature assessment. The passage elicited the 
highest percent correct score among AISD students (95.0%) of 
all 121 literature items. 

The items answered by the smallest percentages of students 
nationwide and in AISD concerned Blake's image of a tiger in 
his famous poem and the theme of Bunyan's Pilgrim's Progress . 
Nationally, only 13.6% of the students answered the Blake 
itvem correctly, compared with 13.2% of AISD students. Only 
13.4% of students nationwide and an equally poor 13.5% in 
AISD knew what Bunyan's novel was about. 
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Performance at the Top and bottom Quarters 

Another apprcac;h for comparing AISD to the nation Is to 
compare the performance of AISD high schools to the national 
sample on the Items In the top and bottom quarters based on 
national performance, in history, this would Include 35 
Items at the top and another 35 at the bottom (of 141 Items) . 
In literature, this would Include 30 Items at the top and 30 
at the bottom (of 121 Items) . 

History . In the top quarter, AISD's performance 
exceeded that of the nation on 20 of 35 Items (57%) , and on 
29 of 35 Items In the bottom quarter (83%). 

o One item in the top quarter on which the percent 
correct for all AISD schools exceeded the percent 
for the nation was "U.S. dropped first atomic bomb 
on Japan in World War II" (item ranked 16 of 141 
nationally) . 

o On the items in the bottom quarter, all AISD schools 
tested exceeded the percent correct for the national 
on five items: 

— "Union membership grew in the 1930s because of new 
laws" (item ranked 113 of 141 nationally) 

— "Restrictions on immigration were not part of New 
Deal" (item ranJced 115 of 141 nationally) 

--"Upton Sinclair, Lincoln Steffens, Ida Tarbell 
known as nuckrakers" (item ranked 120 of 141) 

— "Lyndon Jorinson's term included Medicare and Voting 
Rights Act" (item ranked 137 of 141) 

--"'Progressive movement' reforms before World War I" 
(item ranked 139 of 141) 

o On no History item in the top or bottom quarter did 
the percent correct for the nation exceed the percent 
correct for every one of the AISD high schools 
tested. 

Literature. In the top quarter, AISD's performance 
exceeded that oi' the nation on 23 of 30 items (77%) , and on 
26 of 30 items ir the bottom quarter (8*7%) . 

o On the items in the top quarter, all AISD schools 
tested exceeded the percent correct for the nation 
on five items: 



—••Martin Luther Kirr , Jr. : 'I have a dream...'" 
(item ranked 4 of 161 nationally) 



— '•A dventures of Huckleberry Finn is about orphan 
boy and runaway slave** (item ranked 14 of 121) 

—•^'Friends, Romans, countrymen...' is from Julius 
C aesar ** (item ranked 20 of 121) 

— ''Novel that helped the antislavery movement was 
Uncle Tom '3 Cabin ** (item ranked 24 of 121) 

— **Lucifer is another name for Satan** (item ranked 
27 of 121) 

o On the items in the bottom quarter, all AISD schools 
tested exceeded the. percent correct for the nation on 
six items: 

— **Lan9ston Hughes was poet of Harlem Renaissance who 
wrote 'Hold fast to dreams,' etc.** (item ranked 27 
of 121 nationally) 

— "Geoffrey Chaucer wrote The Canterbury Tales** (item 
ranked 97 of 121) 

— Lord of the Flies is a novel about children 
stranded on island who try and fail to lead 
civilized life** (item ranked 100 of 121) 

— ** Dante's D ivine Comedy is about journey through 
Hell, Purgatory, Heaven** (item ranked 104 of 120) 

— ** Joseph Cci.rad wrote The Heart of Darkness > Lord 
Jim, and The Secret Sharer ** (item ranked 114 of 
120) 

— **Ralph Ellison's Invisible Man is about young man 
who grows up in South, moves to Harlem** (item 
ranked 115 of 120) 

o On no Literature item in the top or bottom quarter 
did the percent correct for the natior exceed the 
percent correct for every one of the AJiSD high 
schools tested. 



These descriptive analyses suggest that the sample of AISD 
eleventh graders tested per formed better . n both history and 
literatur e than students in the national sample . Greater 
percentages of AISO students enswered the items answered most 
frequently by students nationwide, and greater percentages of 
AISD students answered the items answered least frequently by 
students in the national sample. 
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Tests of Significance Between Groups 

Using the Statistical Analysis System (SAS) on AISD's IBM 
maini'rame, a one-way analysis of variance (ANOVA) was 
performed to compare the two groups, AISD and the nation, in 
terms of the students' mean passing rates on each of the 
items on the history test. The analysis was repeated for the 
mean passing rates on each of the items on the literature 
test. The results are shown in Figures 4 and 5. Figure 6 
presents the mean passing rates across items, i.e., the 
overall average of the percent correct for each item, in 
history and literature for AISD and the nation. 

The results showed significant differences between the groups 
in both test areas, history and literature. 

To determine whether there was a significant difference 
between paired items, a paired-comparison t test was 
performed. The mean difference between AISD and the nation 
in history was 6.6014, with a standard error of the mean of 
0.7418. This difference was significant (t = 8.90, 
df « 140, p < .0001). In literature, the mean difference 
between AIPD and the nation was 6.3463, with a standard error 
of the mean of 0.7424. This difference was also significant 
(t « 8.55, df « 120, p < .0001). 

Summary 

Although problems with representativeness of the AISD sample 
and with the comparability of the AISD and national samples 
place limitations on the confidence of the assertion, both 
descriptive and inferential analyses suggest that the AISD 
test takers outperformed the 17 -year-olds tested nationally . 
While this is of local interest to AISD administrators, it 
may also serve as some encouragement to educators in other 
school districts who when hearing and reading eibout the 
national results may have thought as we did, "It can't be 
that bad. I wonder how our students would do on the tests. 
I'd bet they'd do better." ours apparently did, although 
with a 63% passing rate in history and a 60% passing rate in 
literature (just above the failure boundary on Ravitch and 
Finn's scale), there is clearly room for improvement. 
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Figure 4. ANOVA SUMMARY TABLE FOR COMPARING THE PERCENT 
CORRECT SCORES ON THE HISTORY TEST BY AISD AND 
THE NATION 

SOURCE df SUM OF SQUARES MEAN SQUARE F VALUE 



Groups 1 3072.30014184 3072.30014184 9.50* 

Error 280 90540.35900710 323.35842503 

Total 281 93612.65914894 



* p < .0023 



Figure 5. ANOVA SUMMARY TABLE FOR COMPARING THE PERCENT 
CORRECT SCORES ON THE LITERATURE TEST BY AISD 
AND THE NATION 

SOURCE df SUM OF SQUARES MEAN SQUARE F VALUE 



Groups 1 2436.65458678 2436.65458678 5.99* 

Error 240 97669.05024794 406.95437603 

Total 241 100105.70483472 



* p < .0151 



Figure 6. MEAN PASSING RATES ACROSS ALL ITEMS ON THE 
HISTORY AND LITERATURE TESTS 



Test 


Group 


N* 


Mean 


Std 


Dev 


History 


AISD 


141 


62 


.9603 


17. 


7805 


History 


Nation 


141 


56 


.3589 


18. 


1817 


Literature 


AISD 


121 


60 


.4240 


19. 


9321 


Literature 


Nation 


121 


54 


.0777 


20. 


4113 



* M a The nvunber of items 



18 
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Review of the NAEP Item Specifications 



As previously stated, the results reported in this paper 
derive from two sources. This section will focus on the 
rankings of the NAEP item specifications by local reviewers. 
The item specifications, representing the domain of content 
covered by the National Assessment, were chosen for review 
because much of the controversy about instruction in American 
history and literature arose in consequence of the national 
study and the subsequent publication of the results in what 
Do Our 17-Year-Olds Know? . 

As originally envisioned in the operational plan for AISD's 
study, the review activity was intended to answer the 
question, "What are the important things which we should 
teach our children?", the key question on which answers to 
the other questions depended. Accordingly, it was hoped at 
first to assemble "persons with a stake in instruction in 
AISD" to review the item specifications from NAEP before 
proceeding to the other activities planned. However, 
activities surrounding the proposed testing of AISD eleventh 
graders with the NAEP history and literature items assumed 
such prominence that the reviewers were not selected until 
late in the 1987-88 school year. 

Selection of Reviewers 

Two groups of reviewers, one for U.S. history and one for 
literature, were selected. The reviewers represented 
teachers, AISD instructional coordinators, and subject area 
professors from Austin colleges and universities. Forty 
persons, 20 in each area (U.S. history and literature), were 
selected to be reviewers. Teacher nominees were solicited 
within AISD from the secondary instructional coordinators for 
English and social studies. Nominees among the instructional 
coordinatbrs were solicited from elementary and secondary 
administrators. Lists of subject area professors from The 
University of Toxas at Austin, St. Edwards University, 
fluston-Tillotson College, and Concordia College were drawn 
up, and selections were made from the lists. 

Care was taken in selecting the reviewers to include both men 
and women and individuals of different ethnicities. Of the 
20 reviewers selected for the history item specifications, 11 
were men and nine were women; 11 were Anglo, five were Black, 
and four Hispanic. The 20 reviewers of the literature item 
specifications were nine men and 11 women, 13 of whom were 
Anglo, four Black, and three Hispanic. 

The Reviewers ' Task 

Reviewers were sent the NAEP item specifications either for 
U.S. history or literature and were asked to rate each 
specification as to its importance for AISD students. 

id 




Accompanying the specifications and the rating form was a 
letter from the Superintendent enlisting their help. 
Information about the study and the purpose of the review was 
also sent to each reviewer. The cover letter, general 
information and the item specifications are Attachments 10, 
11, 12, and 13, respectively. 

Ten reviewers of the history item specifications and 10 
reviewers of the literature specifications responded. 
Additional efforts were planned in the latter part of summer, 
1988, and at the beginning of the 1988-89 school year to 
persuade the remaining reviewers to submit their ratings. 
However, budget cuts and a rearrangement of evaluation 
priorities precluded any follow-up. 

Data were tabulated and analyzed using the Statistical 
Analysis System (SAS) on AISD's IBM mainframe computer. 
Frequencies of ratings and mean and median ratings were 
calculated for each objective and subobjective in each 
curriculum area (see Attachments 12 and 13). Ratings were 
also calculated by sex and ethnicity. 

Results of the Item Specifications Review 

Literature. The literature item specifications 
contained four objectives: Novels, Short Stories and Plays, 
Myths, Epics, and Biblical Characters and Stories, Poetry, 
and Nonfiction. (See Attachment 13.) On the 1 to 5 scale, 
reviewers rated each objective and subobjective between 1 
( "essential ••) and 2 ("important"). 

Fifty-nine percent of the ratings given were "essential," 31 
percent were "important," and five percent were "somewhat 
important." Only one percent of the ratings were 
"unimportant" (on the Nonfiction objective) . Hispanic and 
Black reviewers were not as disposed to assign "essential" 
ratings as were Anglo reviewers; instead, their mean and 
median ratings favored the "imijortant" and "somewhat 
important" range. Areas rated "somewhat important" included: 
Short Stories, Myths, Heroes, and Legends, and Epics. Female 
reviewers tended to award more favoredDle ratings than did 
male reviewers. Their lowest mean and median rating of 
"important" was for Biblical characters and stories. One of 
the AISD coordinators felt that Biblical Characters and 
Stories should be covered by religious institutions. 
According to this individual, "Teachers are not trained to 
teach Bible stories in public school settings." Another 
important issue raised by a reviewer was the need to teach 
literature to incriBase the understanding of differences, not 
just universal characters, plots, and themes. This reviewer 
felt some emphasis should be given to "the voices of men, 
women, [and] minorities in addition to the so-called 
classics." 
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History . History items were grouped under six 
objectives: Exploration and Colonization: up to 1763, The 
Revolutionary war and the New Republic: 1763-1815, 
Nationhood, Sectionalism, and the civil War: 1815-1877, The 
Civil War, Territorial Expansion, the Rise of Modern America, 
and WWI: 1877-1920, The '^'-eat Depression, the New Deal, and 
WWII: 1920-1945, and Posc-WWII: 1945 to Present. Numerous 
subobjectives were grouped under the objectives. (See 
Attachment 12 . ) 

Much like their literature reviewer counterparts, all of the 
mean and median ratings from history reviewers were between 1 
and 2^ "essential" and "important." One university professor 
stated, "I find it hard to rate any of these listed 
objectives less than 'essential'". Objectives and 
subobjectives receiving 3 ratings ("somewhat important") 
included: 

V. The Great Depression 

D. WWII 

4. The United Nations (e.g., purpose) 
VI. Post WWII: 1945-Present 

E. The 1970 's 

3. Watergate, resignation of President Nixon, 
succession of President Ford. 

Other areas perceived to be important by the reviewers that 
they felt were omitted were: 

o The life of the first Americans prior to the coming 
of the Europeans (Professor, UT Austin) 

o U.S. involvement in the Middle East and Latin 
America (Teacher) 

o The Hispanic theme in American history (Professor, 
St. Edwards University) . 

FjTom a total of 630 responses, 65% and 28%, respectively, 
were perceived a? "essential" and "important". Only 6% of 
the specifications merited a rating of 3 ("somewhat 
important") . Females tended to rank more objectives as 
"essential" (77%) than males (57%) . Anglos, who comprised 
the majority of reviewers, and an Hispanic targeced their 
ratings in the "essential" or "important" range. The sole 
Black reviewer was more likely to assign ratings of 2 
("important") and 3 ("somewhat important") than 1 
("essential") . 
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Problems in Carrying Out the Study 
Problems with the Test Administration 

Although overall the testing vent smoothly, there were a 
couple of problems that inconvenienced school personnel. 
Some received materials later than school personnel wanted, 
and some schools received answer sheets sorted differently 
than expected (despite advance communication from ORE 
concerning schools' preferences) • The worst error was an 
oversight on the part of ORE staff. The answer sheet which 
was supplied to schools contained a maximum of five response 
b\ibbles. Several items, as- it turned out, had six respo;.se 
choices. The difficulty was addressed by providing 
instructions to schools in marking an unused portion of the 
answer sheet if the sixth response choice was taken 
(Attachment 14) . The ORE programmer rewrote the scoring 
programs to accommodate the marking change. 

Two other problems are worth noting. The first concerned 
test security. In materials returned to ORE from one school, 
one test booklet was not initially accounted for. This 
missing booklet was extremely problematic in view of the 
nondisclosure agreement with NAEP. After an exchange of 
telephone calls and a memo to the principal, the missing 
booklet was discovered to have been returned improperly. The 
end result was that all test booklets were accounted for. 

The second problem arose from schools not following 
directions with respect to ensuring that students filled in 
the test form (see Attachment ) . Several dozen answer 
sheets were returned to ORE with the test form left blank. 
In some instances, ORE staff were able to ascertain which 
form should have been marked; e.g., L2 had 31 items, while 
LI, L3, and L4 had 30, and H3 and H4 had 35 and 34 
items, respectively, while HI and H2 had 36 items. However, 
iv was not possible to determine which form had been taken by 
a student in all cases, and as a result, some answer sheets 
could not be scored. As mentioned previously, nearly all of 
one school's answer sheets lacked the form number, so the 
school did not receive summary results. 

These problems notwithstanding, the participating campuses 
were generally cooperative, communication between ORE and the 
schools was open and continuous, and the testing appeared to 
have been well executed. 

Resistanc e to the Study 

A study such as this one, which take3 for its point of 
departure a nationally publicized, politically charged issue 
(how much high school juniors know about U.S. history and 
world literature, and what to do about it) is bound to 
encounter difficulties simply because of the emotions roused 
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by the issue. While reactions ran the usual gamut for new 
studies from "Why are we doing this? This is a stupid idea," 
to ••Testing is fine, but let us choose the students," to 
••This is an interesting study — I'm curious to find out how it 
will turn out,^^ this study seemed to encounter more than 
normal resistance, particularly on the part of local campus 
personnel. 

Although np one challenged the importance of examining the 
content of the history and literature curricula, there may 
have been resistance grounded in genuine philosophical 
differences with the values implicit in the design of the 
study. Most of the resistance to the istudy, however, was 
procedural, i.e., concerned with what was to be done and 
when. Several rounds of meetings, memos, and phone calls 
were devoted to questions about which students were to be 
tested, how much testing time they should be allowed, when 
and where the testing should take place, what materials would 
be provided, and who would coordinate the testing. Some of 
the changes the plans underwent have already been mentioned. 
Attachments 2 and 3 detail what was finally decided. 

Another kind of resistance had at its root a concern that 
individual school principals and the District c.s a whole 
might be embarrassed by the results. Principals evidently 
saw the testing as a kind of accountability exercise and were 
wary of the outcomes. The Superintendent was particularly 
chary of the results potentially becoming another source of 
negative publicity in the local media, especially in the 
local newspaper which had adopted something of an adversarial 
stance with respect to governmental entities in Austin. 

Of course, and with some justification, there was objection 
to any increase in testing from campus administrators and 
faculty. However, since the testing was originally the 
Superintendent's idea, the schools' cooperation was expected. 
In this expectation ORE staff were disappointed, because 
ultimately, at a principals' meeting at which objections to 
the testing were voiced, the Superintendent directed that the 
testing be entirely volimtary. (Curiously, in all of the 
discussions, other than ORE staff, no one paid much attention 
to what students might think about the testing and what 
information they should receive before and after the 
testing. ) 

Implications 

This study of the content in the curriculum has a number of 
implications for AISD and for any other school district which 
might decide to undertake a similar study. 

!• Befor e embarking on a study with strong political 

overtones, it is imperative that the "front-end" work be 
completed . 
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Questions like the following must be thoroughly explored with 
all of the study's participants: 

o What is the purpose of the study? 

o Who is requesting that it be conducted and why? 

o What resources will be required for the study? 

o What will be given up in order to do the study? 

o How will the results of the study be used? 

o What will the impact on the curriculum be? 

These are basic questions, and as experienced research and 
evaluation staff, we formulated answers which satisfied us, 
but, irr retrospect, the persistent challenges to the study's 
activities may be seen as indicating that these questions 
were never entirely resolved for the study's participants on 
the campuses, despite numerous discussions and written 
communications • 

It is possible that had greater efforts been made to examine 
these questions in the early going that some resistance to 
the study would have been dissipated, but it seems to us that 
the continuing resistance was less a failure of communication 
on the part of ORE staff than a failure of upper-level 
administration to support the study beyond its inception. 

2. It is necessary that the researchers have the necessary 
authority and support from the highest administrative 
levels in the district to carry out a comprehensive 
study ^ like this one of curricula or any other. 

When the ideas which eventually became the content in the 
curriculum study first surfaced, there were a number of 
discussions with the Superintendent and other of the 
District's top administrators about the study. A 
comprehensive study design which required the cooperation and 
assistance of personnel in the instructional departments was 
cooperatively fashioned, and, as previously mentioned, 
favorably received by the Superintendent and adopted by the 
Board of Trustees. 

However, after fleshing out the study concept and seeing it 
underway, the Superintendent and administrators did not, in 
the end, support the study as originally conceived. 
Cooperation from administrators in Elementary and Secondary 
Education was perfunctory, and when high school principals 
voiced objections to the testing, the Superintendent weighed 
their objections against the integrity of the design and 
chose to satisfy the principals. 

This was a bitter experience for District researchers. 
Although it was certainly his prerogative to change his mild, 
the originator of the study idea, the Superintendent, did not 
exercise the authority necessary to ensure that a random 
sample yielding defensibly comparable results would be 
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selected. Instead, in our judgment, the Superintendent was 
willing to settle for an unknown sample, whose results might 
be indicative but hardly definitive. 

The consequences of this lack of support for the study were 
several. First, there were opportunity costs. To add the 
study to the research and evaluation agenda, it was 
determined that another evaluation would either have to be 
dropped or reduced. Hence, another evaluation, which was to 
have been the culmination of a three-year study, was 
restructured, and certain long-standing questions were left 
unexamined. Second, the credibility of research and 
evaluation staff was damaged, and working relationships with 
campus staff were strained. In short, when administrative 
support for the study was not forthcoming, the study was 
drastically impacted and the researchers we^ in effect "left 
holding the bag." 

In the final analysis, ORE would have done better to have 
developed a minimum plan to implement the Superintendent's 
request, rather than have been stuck with an ambitious plan 
that proved to be beyond the interest and commitment of even 
the administrators who helped design it. 

3« Researchers and administrators are different, and not 
every study can be completed . 

We say this somewhat tongue in cheek, but it is well for 
researchers occasionally to remember and reflect on the 
differences between themselves and school administrators. We 
as researchers customarily view the world as a place where 
rational decisions can be made based on properly obtained, 
valid data. Administrators are accustomed to relying on 
their intuition fed by information from a variety of sources. 
Researchers are accustomed to explore questions in a 
methodical, step-by-step fashion through to some resolution. 
Administrators are readier to take a hopscotch approach, 
changing the focus of inquiry as circumstances seem to 
dictate. When an administrator expresses an informatics 
need, it is incumbent on the researcher to respond to the 
request in the context which gave rise to it, and, further, 
not to be surprised if the need changes. 

In AISD, the environment in which the content in the 
curriculum study was engendered changed. When faced with 
continuing objections to the testing, the Superintendent 
decided that the testing did not have to be done as specified 
in the evaluation design. Administrative priorities in 
Secondary Education changed and anticipated assistance did 
not become available. In short, the initial commitment to 
the study as originally conceived changed. Unfortunately, 
this change resulted in data of unknown validity and an 
unfinished study. 



o 
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If this line of inquiry into what students know or do not 
Icnow about history and literature (or any other curricular 
area), and what they should know, (i.e., be taught), Is to be 
productive, future research will ne<dd to be more orderly than 
that attempted in AISD. Judging by the reaction of local 
reviewers of the NAEP item specifications, there is a great 
deal of interest among educators in curriculum content. 
There is likely as keen an interest among the general public. 
As was intended in AISD's original study design, this is the 
logical place to start. Testing, while extremely important, 
should then and only then take place. Obviously, unlike what 
eventuated in AISD, students should be randomly selected. 
Finally, there should be a plan for how to present the 
results, within the district and to the media, and for how 
the results would be used to improve the teaching and 
learning situation for the students in the district. Under 
these. conditions, a study such as that attempted in AISD 
could prove truly useful in curriculum reform, and not merely 
jumping on a fashionable bandwagon. 
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ATTACHMENT 1 



OATH OF SECURITY AND CONFIDENTIALITY 



I, ,^do solemnly swear, or affirm, 

(Print full name or principaT)* 
that upon receipt of the assessment materials listed below, I hereby 
igree that I will not disclose^ nor make available to any persons other 
than those directly connected with the assessment, any part of the 
assessment materials. These materials are confidential. This oath or* 
affinw^tion is intended by me to extend to all activities conducted as a 
part of the adnini strati on of the test. 

I hereby certify *hat I have maintained dll th;i security provisions 
of the assessiMent. I hav3 neither retained a copy of the test, 
reproduced a copy of the test or any test iteffl(s), nor divulged to 
another individual the content of the test or the content or correct 
answer of any test item. 

I certify that I have read this oath or affirmation and that I 
fully and completely understand the contents. I acknowledge that failure 
to abide by this, my oath or affirmation, will make me subject to 
professional sanctions and penalties as can be imposeu by law and 
District policy. 

As a testament of this oath I affix my signature below. 
Executed this day of , 19 . 



(Signature of Principal) 



(Campus Name) 
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ATTACHMENT 2 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
D«partmMt of H«n«g«m«nt Information^ 
Office of R«Sttarch and Evaluation 



ASSESSMENT OF IITH GRADBBS IN HISTORY AHD/OR LITERATURE 

Spring, 19dd 
. Building Taat Coordinator Chackliat 
BTC Nama: 

You ahould hava tha following matariala from ^RE? 

« Praaortad taat booklata (Hiatory and/or Litaratura) 

• Anawar ahaatc (praaluggad, if raquaatad) 

• Fact Shaat« for taachara and auudanta <ona for aachJ 

• Taachar Ch«ickliata <ona for you, ona for aach taac^ar) 

• Oath of Saourity and Conf idantiality (Principal) 
« Hiatory/Litaratura Booklata Invantory 

You ahould hava tha nuabar of anawar ahaata and booklata you 
raquaatad plua 10^ axtra. 

Taat booklata hava baan praaortad in tha ordar of Hl» H2« H3» 
H4, o.r Li, L2, L3, and L4, raapactxvaly , ao that forma will 
ba diatvributad to atudanta in an approximataly aqual numbar • 
Plaaaa nota that tha '*17** pracading tha form numbar haa no 
aignJLf icanca for thia taating and ahould ba ignorad. 

Nota that if your achool ia adminiataring both taata, thara 
will ba aaparata booklata and anawar ahaata for Hiatory and 
for Litaratura • 

If you do not hava tha corract amou:nt of matariala, or if you 
naad additional matariala, plaaaa call Latticia Galindo at 
ORE (456-1227). 

NOTE: DO NOT LET STUDENTS DELIVER OR PICK UP TEST MATERIALS! 



ECi9S SiS 



Raad tha Syll^iOS Ififi^ Ogos:^iQatO£ Cbsskliat and tha Taaghar 

Racord tha axact quantiti^a and aaquanca numbars of taat 
booklata to ba givan to aach taachar on tha tii§&9E2£Z 
Li&9£S&U£9 fi99lSl9i9 lQ29Q&9£^* ^o not diatributa booklata to 
taachara until tha day of tha taating. 

Diatributa to taachara tha Taachar Chackliata and Taachar and 
8&Ud9&Si £flSl& SI199Jb5* Hava taachara raad thaaa matariala and 
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ATTACHMENT 2 
(Continued, page 2 of 4) 



# • you if thmy hav« any quaationa. 

Convay to tha principal tha Qat{} 9^ §fiS^£i^Z SQ^ 
SSQ^i^SQi ifili^X principal 'a aignatura. Tha oath 

raquiraa tha principal to attaat that atrict taat aacurity 
haa baan aaintainad and that no raproduction of taat booklata 
haa occurrad. It ia important that , taat itama ramain 
conf'idantial ao that thair utility for raaaarch purpoaaa ia 
not conproAiaad. 

If your achool racaivad praaluggad anawar ahaata^ taachera 
will naad to chack for corractly codad: 



<IF PRESLUGGED INFORMATION IS INCORRECT, DO NOT ATTEMPT TO 
CHANGE IT. AT THE TOP OF THE ANSWER SHEET, NOTE WHICH 
INFORMATION IS INCORRECT AND SUPPLY THE CORRECT INFORMATION. 
ORE WILL CORRECT THE ANSWER SHEET LATER) . 

If your achool did not raquaat praaluggad anawar ahaata. 
anawar ahaata will hava only achool nama and numbar and tha 
typa of anawar ahaat (Hiatory or Litaratura) praaluggad. On 
thaaa anawar ahaata, atudanta wa 11 naad to complata atudant 
naaa, atudant nuabar, and grada. 

On fill «na%#ar aha«ta, atudanta will naad to aark tha form of 
tha booklat thay racaiva in row nuabar 172. Saa Directions 
f9£ CoaQ^ating %l\m Studant Anawar Shaat. 

Oiract taachara to raaova or covar any bul latin board 
diaplaya or othar diaplaya of information that could aid 
atudanta during taating. 

Oiract taachara to tall atudanta to bring at laaat two #2 
pancila for tha taat. Taachara naad to maintain axtra 
pancila on hand aa wall. 

Diract taachara to hava a watch or clock with a aacond hanc . 



Diatributa to taachara taat booklata and anawar ahaata. 
Taachara muat initial on tha HlS^QSIZ^kl^SSS^urg i2S!sj:S&S 
lQ!fSQ£9SY that thay racaivad tha booklata apacified. 

Hava taachara paaa out taat booklata # anawar ahaata ^ and Fact 
Shaata . 

Hava taachara racord atarting and anding timaa of taating on 
tha ItasbfiS Sb9SiSiia£- 



School nama and rumbar 
Studant nama and numbar 
Taachar nama and numbar 
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ATTACHMENT 2 
(Continued, page 3 of 4) 



Thm tttach^r or a proctor should hm proasnt in the room during 
teating > 

• 

Su99Mt to tef^iC^cra/proctora that they move quietly around 
the room to m«:W« oure etudente are m/irkimj their anawera 
properly on the anewer eheet. 

Streee that atudenta myij^ qs& write in their teat booklets. 

Have teachera tell thoae atudenta who fiaiah early to check 
quietly over their work. 

Have teachera inatruct atudenta that after the teat» 
mater iala are to be arranged in two atacka: 

<17 Teat book lata 
<2) Anawer aheeta 

Inatruct teachera that prior to turning mater iala in to you, 
they need to do the following: 

• Count teat bookleta 

• Check aequence numbers 

• Record commenta on Taaciier Checklist (optional) 

Make sure that all mater iala (including the Oath and Isagbsr 
Q&lSh^iS^^ arranged in good order prior to returning to 

ORE. 

PLEASE note: tests WILL NOT BE SCORED UNTIL THE Q^Iii QE 

SSfiysm m SQHEICEHlIALm is signed by the principal and 

RETURNED TO ORE. 

Mail or deliver m^teriala to ORE. 

If you have any queationa, pleaae contact Letticia Galindo or 
David Wilkinaon at ORE <45d-1227). 
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ATTACHMENT 2 
(Continued, page 4 of 4) 



HISTORY /LITERATURE BOOKLETS INVENTORY 



TO THE BUILDING TEST COORDINATOR 

On th« day b«for« th« t««'t, r«cord th« ttxact quan'tltl«a and aaquenca 
nuRb«rs of tm»t. bookl«ta giv«n to each t«ach«r . TEACHERS MUST 
INITIAL THAT THEY HAVE RECEIVED THE MATERIALS SPECIFIED. 

TEST NUMBER OF SEQUENCE 

iQQSLSIS iQQSLSIS NUMBgRS 1EACHE8__ TgACHER INITIALS 
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ATTACHMENT 3 



AUSTIN iriDEPGNDENT 5CH0UL DISTRICT 
Department of NariaqeiTien+* 1 nfcM-rM,::^!" i ori 
Office of Research and Evaluation 



ASSESSMENT OF IITH GRADERS IN HISTORY AND/QR LITERATURE 



The Building Test Coordinator should provide you ^Aiith the 
To 1 lowi ng mater i al s : 

* Teacher Check 1 1 st ^ with D i rec t ions for Comp let i ng th-3 
S cudent Answer Sheet 

* Presorted test booklets (History and/or Literature^ 
^ Answer sheets < preslugged ^ if schoo 1 requested ^ 

* Fact Sheets for you and students (one for each) 

Test booklets have been presorted m the order of HI ^ H3% 
H^, or Ll^ L2, L3^ and Lh-. respec 1 1 vely ^ so that forms will 
be dir.tributed to students in an appro), imately equal number. 
Please note that the "l^*' preceding the form number hci« no 
eignificance for this testing and should be ignored. 

If you are administering both tests, there will be separate 
booklets and answer sheets for History ar»d Literature. 

NOTE: DO NOT LET STUDENTS DELIVER OR PICK UP TEST MATEPIALS' 



Prior to Testing 

Receive from Building Test Coordinator the leacher Checklist 
and Fact Sheets. Read these materials and see the Building 
Test Coordinator if you have any questions. 

If you received preslugged answer sheets^ please chec^- 
for correctly coded: 



(IF PRESLUGGED INFORMATION IS INCORRECT, DO NOT ATTEMPT TO 
CHANGE IT. AT THE TOP OF THE ANSWER SHEET, NOTE WHICH 
INFORMATION IS INCORRECT AND SUPPLV THE CORRECT INFORMATION- 
ORE WILL CORRECT THE ANSWER SHEET LATER.) 



Spring , 1998 



Teacher Checkl ist 



Tea*cher Name : 



o School name and number 
o Student name and number 
o Teacher name and number 




:-=:ilJfe|3^^-...:-..~... 
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ATTACHMENT 3 
(Continued, page 2 of 5) 



Tf vou did not receive pr-^s lugned arisv^jer ^hef.-i-^^ ^ stu'if^-ri- 
'iill need to cc«mplete the foilov^iing prior l:o the tcsi-: 



D Student name and number 
o Grade 

On all answer sheets^ students will need to f^i\r[ tht- forrn or 
the bool let th^v receive in row number 172. Sec? Dl «:Si!lJ21£'r*= 
TJ^C Comp let i nq the Student Answer Sheet- 

Remove or cover bulletin board displays or other di^=plav"» of 
information that would aid students during testing. 

Tell students to bring at least two #2 pencils for the tte=t*- 
Ma^ e sure to maintain eiitra pencils on hand. 



Obtain a watch or clock with a second hand. 



T^t Day Procedures 



Receive from Building Test Coordinator te<=t booklets anJ 
answer sheets. On the Histor;;^/L2 terature B£»£'JL-i^iS l}j:i^JDt'-i£j: ^ 
you must initial that you have received the boo^ lets 
specified . 

Under no circumstances are you to reproduce any test booklet 
or disclose the content of any test item. It is important 
that test ite<is remain confidential so that theii utility for 
research purposes is not compromised. 

Rass out test booklets, answer sheets, and F^ct .£h*=i»r:j;^|. . 
BOOKLETS ARE ALREADY PRESORTED AND SHOULD BE GIVEn"iG 
STUDENTS IN THIS ORDER: HI, H2, H3, then HI agair,, H2, 

etc. The same sequence should be followed for Li tera-i'Lir -^^ • 

Give students an opportunity to read the Fact Sh^e t , Ple-i-ii- 
inform them that they can keep these (you can ^eep vour^= 
as v-jel 1 ) . 



ERLC 



Briefly describe for students the testing procedures and 
after- test procedures. Lead students through the direction" 
for marking test form and checking preslugged information^ as 
apprpriate. See Direct^ions for ComB_leting the Student AjD^^l^E 
Sheet . 

Stress that students must not write in their te=t bool- lets- 
Do not assist students inappropriately during the tG<=, b. 
Tell students to erase unwanted answers thoroughly. 

If students finish early^ instruct bhem to checl- quietl/ 
over their work. 
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ATTACHMENT 3 
(Continued, page 3 of 5) 



RECORD STARTING AND ENDING TIMES OF TEST 
S TARTING ENDING 



Someone should be present m the room during testing. 

nove quietly around che room to observe whether students 
are marking their answers properly on the answer sheet. 

After Testing 

Once testing is completed, tell students to arranQe materials 
in two stact..s: (n test booHets and (2) answer sheets. 

It Y.5.y. iLL® t^l.tLQg. LQ both Hi.storY. ^Ql ULt^C^^.t'^^-ie^ llL^>f.t 
coLL?,ct and stact. test boo!;,l_et5 and answer sheet ^ from nne 
sub jL^ct area \ef ore aassi.Qg. out boo^Lets and answer rheet= 

Count test boot lets: Historv Literature 

Chec^ sequence numbers, if neces'sary: 

HI HS H3 

Li L2 L3 L'-^ 

Please feel free to use the back of this checklist to 
document any observations you made about the testing proce-=s 
which you think ORE should know. 

Turn m all materials ^e-icept Fact Sheets) to euilcimq Tz-sb 
Coord 1 nator . 
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ATTACHMENT 3 

(Continued, page 4* of 5)- 
Directions for Completing the Student Answer Sheet 



ID IfE liii^CHFR 

Please note that if vour school requested pres luqqed answer 
sheets* they should contaii^j the following information: 

Schoo 1 name and number 

* Grade 

* Teacher name and number 

* Student name and number 

^ Form c History or Li terature ) 

If your school did not request presluqged cAn*=wer ^iheetsj iho- 
will only contain the f o 1 1 owi ng i nf ormat ion: 

^ School name and number 

^ Form ( Hi story or Li t era ture > 

A 'i^ample answer sheet with fch'^* different sections desigiiatiid 
has been provided as a guide. 

On all answer sheets* students will need to mar^ the fos ni of 
the booklet they receive (see below). 

Once students receive their answer sheets and test bocTlets^ 
JlD® fc'lifii^ing aloud to the students: 

JO JHE SiypENT 

PLEASE NOTE THE SECTION OF YOUR ANSWER SHEET CONTAIN ITiG PHIJ 
NUMBERS 171-17a. These correspond to the test and boof iet 
you received. If you received a History booklet* this is 
indicated by an "A" in 171; a "B" if it is a Lit-^rature 
booklet . There are a total of S boo^. lets (s- Histor / and h 
Literature) which are designated Hi, H2. H3, H^ and LI. L£ , 
L3* and L4. respect i vol v ■ 

In row number 17S: 

Mark "A" if you received Booklet HI or LI. 

Mark "B*' if you received Booklet H2 or L2. 

Mark "C" if you received Booklet H3 or L3 . 

Mark "D" if you received Booklet H^ or L''4 . 

It is essential for scoring purposes that the wrong test lev 
not be mistakenly used because booklets were not mar^ ed 
properly. In addition? this information serves to help ORE 
keep track of booklets and answer sheets for all ^studenbs 
tested . 

IF VOU ARE TAKING THE HISTORY ASSESSMENT h G'EGTN liAPh ir.'G VOUP 
ANSWER SHEET WITH « 13. 

IF YOU ARE TAKING THE LITERATURE ASSESSMENT. BE-.GIN MAPh UiO 
YOUR ANSWER SHEET WITH « 19. 
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ATTACHMENT 3 
(Continued, page 5 of 5) 



Directions for Completinq the Student Answer Sheet 



TG I HE T^ACHEP 



STUDENTS ARE TO SKIP THE FOLLOWING QUESTIONS ACCORDING TO 
BOOKLET AND FORM NUMBER: 



HI 

H2 

H3 

H4 

LI 

L3 





•12, ■^9-61 

•12, '49-61 

-IE, 48-60 

.-IS, 47-59 

.-13, 49-72 
-IG, SO-'TG 
-18, 49-72 
-18, 49-72 



Please check to see that students have marted the correct 
form numbers on their a i-is.w ej- - sheets and that they h-A--y<= mar^ ed 
their answers in the proper space? . 
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ATTACHMENT 4 



AUSTIN INDEPENDENT SCHOOL DISTRICT 

Department of Management Information 
Office of Research and Evaluation 



ASSESSMENT OF IITH GRADERS IN U.S. HISTORY AND/ OR LITERATURE 



Spring, 1988 



Fact Sheet 



TO THE TEACHER: 
About the Test 

You are about to administer a test either of U.S. history or 
of literature. There are four forms of each test divided up 
among four booklets. The history test booklets are labeled 
HI, H2, H3, and H4. The literature test booklets are labeled 
LI, I^, L3, and L4. Booklets should be passed out to students 
in this order. Depending on which form the student receives, 
each student will answer from 34-36 history questions and/ or 
30-31 literature questions. 

Preceding and following the knowledge component of the test 
are approximately 11-12 questions pertaining to coursework. 
The students should skip these items. 

Estimated working time for each test (history and literature) 
is approximately 14 minutes but a total of 20 minutes should 
be allotted to ensure students will have eonple time to take 
the test (40 minutes if both tests are given) . 



Why It's Being Given 

The purpose of the test is to determine whether AISD students 
are learning important content in American history and 
literature. Although the test will not be used to determine 
student's grades in these subjects or affect their graduation 
status, the results should provide your school with valuable 
information about what is being taught and what needs to be 
taught in these subject areas. Therefore, please encourage 
the students to give it their best effort. 

Testing materials and directions should be obtained from the 
Building Test CoorHInator . 

Thank you for your cooperation in this important testing 
effortl 



Page 3\ 



ATTACHMENT 5 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
Department of Management Information 
Office of Research and Evaluation 



ASSESSMENT OF IITH GRADERS IN U.S. HISTORY AND/ OR LITERATURE 



Spring, 1988 



Fact Sheet 



TO THE STUDENT: 

The test you are eUsout to take consists of questions designed 
to measure your knowledge of U.S. history and/or literature. 
At the beginning and end of the test, there are approximately 
11-12 questions that deal with coursework in these subject 
areas. Skip these questions . 

The estimated working time for the test is approximately 14 
minutes, but you will be allowed 20 minutes (40 minutes if 
both tests are given) . 

The purpose of the test is to determine whether AISD students 
are learning important content in American history and 
literature and to compare their performance with the 
performance of students nationwide. Although the test will 
not be used to determine your grade in tnese sxib-jects or 
aTIeci your graduation status , the results shouia provide 
your school with valuable information about what is being 
taught and what needs to be taught in these subject areas. 
Therefore, please give it your best. effort. 



THANK YOU FOR YOUR COOPERATION. GOOD LUCK! 
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MARKING INSTRUCTIONS 
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1 74 


107 


61 
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1 23 


THb CIVIL WAR UCCURRbU okTWbkN laoU-I^UO 


172 


69 


40 


1 


129 


115 
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1 74 


Aft 


39 


1 


131 


134 


MAGNA CARTA IS FOUNDATION OF BRITISH PARLIAMENTARY SYSTEM 


173 


58 


33, 


5 


132 


129 


ANDREW JACKSON WAS PRESIDENT BETWEEN 1820-1840 


173 


64 


37 


0 


133 


130 


REFORMATION LEO TO ESTABLISHMENT OF PROTESTANT SECTS 


172 


62 


36 


0 


134 


1 16 


THE UNITED NATIONS WAS FOUNDED BETWEEN 1943-1947 


176 


76 


43 


2 


135 


136 


THE SENECA FALLS DECLARATION CONCERNED WOMEN'S RIGHTS 


176 


55 


31 


3 


136 


141 


ABRAHAM LINCOLN WAS PRESIDENT BETWEEN 1860-1880 


173 


35 


20 


2 


137 


94 


LYNDON JOHNSON'S TERM INCLUDED MEDICARE NO VOTING RIGHTS ACT 


173 


98 


56 


6 


138 


138 


BETTY FRIEDAN AND GLORIA STEINEM LED WOMEN'S MOVEMENT IN 1970S 


176 


44 


25. 


0 


139 


131 


"PROGRESSIVE MOVEMENT" REFERS TO REFORMS BEFORE WW I 


173 


62 


35. 


8 


140 


140 


"RECONSTRUCTION" REFERS TO READMISSIDN OF CONFEDERATE STATES 


176 


42 


23. 


9 


14 : 


139 


JOHN WINTHROP ANO THE PURITANS FOUNDED A COLONY IN BOSTON 


172 


43 
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ITEM 



ff STUDENTS 



DESCRIPTION 


^ C Y ftJff ftl^ t ^ C ft J 

RECEIVING ITEM 


CORRE CT 


CORRECT 


IN BIBLE, NOAH GATHERED PAIRS OF CREATURES INTO ARK 


178 


163 


91 


6 


IN BIBLE , MOSES GOT 10 COMMANDMENTS, LEO HIS PEOPLE FROM EGYPT 


165 


149 


90 


3 


ROMEO AND JULIET HINDERED BY FEUDING FAMILIES 


159 


1 <l O 


91 


2 


MLK, JR.: "I HAVE A DREAM..." 


179 


170 


95 


0 


HAMLET: "TO BE OR NOT TO BE..." (5 LINES) 


lob 


1 <|J 


86 


7 


EBENEZcR SCROOGE WAS STINGY CHARACTER IN "A CHRISTMANS CAROL" 


17G 


158 


88 


8 


IN GREEK MYTHOLOGY. RULER OF GODS IS ZEUS 


165 


149 


90 


3 


WHITE RABBIT. MARCH HARE. ETC.. ARE IN ALICE IN WONDERLAND 


178 


152 


85 


4 


ROBIN HOOD IS KNOWN FOR STEALING FROM RICH TO GIVE TO POOR 


159 


143 


89 


9 


CINDERELLA'S RAGS TURNED INTO GOWN AND SHE MET PRINCE 


179 


152 


84 


9 


ROBINSON CRUSOE WAS SHIPWRECKED ON AN ISLAND AND SURVIVED 


165' 


1 35 


81 


B 


"THE LORD IS MY SHEPHERD..." (3 LINES) IS FROM PSALM 23 


178 


1 5 1 


84 


8 


THE MAGICIAN WHO ADVISED KING ARTHUR WAS MERLIN 


178 


146 


81 


5 


ADVENTURES DF HUCKLEBERRY FINN: ORPHAN 6QY AND RUNAWAY SLAVE 


159 


146 


91 


a 


IN BIBLE. BOOK OF GENESIS INCLUDES ACCOUNT OF CREATION 


165 


133 


80 


6 


PLATO AND ARISTOTLE ARE BEST KNOWN AS PHILOSOPHERS 


178 


149 


83 


7 


VICTORY DF UNKNOWN TEAM PARALLELS BIBLE STORY OF DAVID & GOLIATH 


179 


142 


79 


3 


"RIP VAN WINKLE" IS ABOUT MAN WHO SLEPT FOR 20 YEARS AND AWOKE 


165 


130 


78 


8 


E.A. PGE WROTE "PIT AND PENDULUM." "FALL DF HOUSE OF USHER," ETC. 


159 


123 


77 


4 


"FRIENDS. ROMANS, COUNTRYMEN... IS FROM "JULIUS CAESAR" 


179 


1 57 


87 


7 


JULIET SAiO. "WHAT'S IN A NAME? THAT WHICH WE CALL A ROSE..." 


178 


140 


78 


7 


GETTYSBURG ADDRESS: FOUR SCORE o SEVEN YtARb AGO OUR rAIHtRb... 


165 


1 ^ o 


75 


B 


SHELLEY S FRANKENSTEIN: SCIENTIST MADE CRtAIURt CUULU NOI CUNIRUL 


159 
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1 oy 
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1 b J 


85 
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1 oy 
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73 
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JtbUb WAb btlKAYtU rUK JU ritUtb Ur OlLVCK DT UUUAd 


I/O 


1 1 T 

ill.} 


63 


5 


c n T ri/ T KiQnKi aufditakj pdft i iufd iki ^ni TTlJflF WDDTP ARniJT flFATH 

C. UiUl\ilM^UIM. AMCKiUAIM rUCI, LiVCU in OULilUUt, NKUIb MDUiil UtMlrl 


159 


104 


65 


4 


UriDAI riF TDDTDI^F AMD HADF * ^ 1 HW AMD ^TFARV WTKI^ THF RACE 


159 


117 


73 


6 


TKJ PAIKJ AMD ARFI ^TDDV JFAI nU^ VDUKIf^ MAN KII 1 ^ RPnTHFP 


165 


1 14 


69 


1 


<^HFRI nrk HDLMFS* MAIN CHARACTER IN HOUND DF THE BASKERVILLES ETC 


165 


127 


77 


0 


Fnr;AR allan pde wrote poems "Annabel lee" and "Raven" 


178 


122 


6B 


5 


IN ROMAN MYTHOLOGY, VENUS IS GODDESS DF LOVE 


178 


134 


75 


3 


"WE HOLD THESE TRUTHS....": DECLARATION DF INDEPENDENCE 


159 


1 18 


74 


2 


"WE. THE PEOPLE...". PREAMBLE TO THE CONSTITUTION 


159 


126 


79 


2 


THORNTON WT.DER PLAY ABOUT TYPICAL NEW ENGLAND VILLAGE: "OUR TOWN" 


159 


1 1 1 


69 


B 


AESOP IS BEST KNOWN FDR WRITING FABLES 


179 


123 


68 


7 


IN GREEK MYTHOLOGY. MULTITUDE OF EVILS ESCAPED FROM PANDORA'S BOX 


165 


109 


66 


1 


HEMINGWAY WROTE "FDR WHOM THE BELL TOLLS**. "THE SUN ALSO RISES" 


159 


B6 


54 


1 


JACK LONDON WROTE "CALL OF THE WIlD" AdOUT DOG IN YUKON 


178 


1 12 


62 


9 


ROBERT FROST POEMS: ".. PROMISES TO KEEP...." "TWO ROADS..." 


179 


104 


58 


1 


IN MELVILLE'S "MOBY DICK". CAPTAIN AHAB'S OBSESSION IS REVENGE 


165 


B8 


53 


3 


LILLIPUT. COUNTRY DF LITTLE PEOPLE. PART DF "GULLIVER'S TRAVELS" 


165 


102 


61 


8 


"THE RED BADGE DF COURAGE": SOLDIER'S STRUGGLE TO OVERCOME FEAR 


165 


119 


72 


1 


IN GREEK MYTHOLOGY, ATLAS HAS TO SUPPORT HEAVENS ON HIS SHOULDERS 


179 


1 16 


64 


8 


IN BIBLE. KING SOLOMON IS FAMOUS FDR HIS WISDOM 


159 


96 


60 


4 
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ERIC 



ITEM 
DESCRIPTION 

THE ILIAO IS A^' EPIC POEM BY HOMER 

IN BIBLICAL STORY. JONAH IS SWALLOWED BY BIG FISH 

IN MARK TWAIN NOVEL. TDM SAWYER IS KNOWN FDR CLEVER WAYS OF WORK 
MIOAS WAS MYTHICAL KING WHOSE TOUCH TURNED OBJECTS TO GOLD 
"THE SCARLET LETTER" IS NOVEL ABOUT WOMAN WHO WAS UNFAITHFUL 
"TO KILL A MOCKINGBIRD": 2 CHILDREN'S FATHER DEFENDS BLACK MAN 
DICKENS' NOVEL TALE OF TWO CITIES OCCURS DURING FRENCH REVOLUTION 
LONGFELLOW WROTE POEM ABOUT PAUL REVERE: "ONE IF BY LAND...." 
FOR SAID: "THE ONLY THING WE HAVE TO FEAR...," " 12 -7 -4 1 . . . INF AMY " 
IN ADDITION to PLAYS. SHAKESPEARE ALSO WROTE SONNETS 
YOUNG MAN WHO WASTES FORTUNE. COMES TO SENSES LIKE PRODIGAL SDN 
IN ROMAN MYTHOLOGY. MARS IS GOD OF WAR 

W. CHURCHILL: "I HAVE NOTHING TO OFFER...." "...IRON CURTAIN..." 
ARTHUR MILLER WROTE "THE CRUCIBLE" AND "DEATH OF A SALESMAN" 
A "RAISIN IN THE SUN" IS ABOUT EXPERIENCES OF BLACK FAMILY 
JFK: "..,ASK NOT WHAT YOUR COUNTRY CAN 00 FOR YOU...." 
IN GR^EK MYTHOLOGY. JASON TRAVELED IN QUEST OF THE GOLDEN FLEECE 
"THE GREAT GATSBY": NOVEL BY F. SCOTT FITZGERALD 

OEDIPUS: KILLED FATHER AND MARRIED MOTHER IN ANCIENT GREEK PLAY 
"ACHILLES' HEEL" MEANS WEAK POINT IN STRONG PERSON 

IN GREEK MYTH. DAEDALUS & ICARUS MAKE WAX WINGS. TLY CLOSE TO SUN 

ODYSSEUS IS MYTHICAL GREEK HERD WHO JOURNEYS HOME AFTER TROJAN WAR 

BYRON. KEATS. AND WORDSWORTH ARE CHIEFLY KNOWN AS POETS 

SHAKESPEARE'S "JULIUS CAESAR" IS ABOUT THE FATE OF HIS ASSASSINS 

DON QUIXOTE WAS SPANISH KNIGHT WHO ATTACKED WINDMILLS 

MACBETH: PLAY ABOUT MAN LED TO MURDER BY AMBITION TO BE KING 

"TO EVERY THING THERE IS A SEASON....". THE BIBLE 

IN BEOWULF. THE HERD BATTLES WITH THE MONSTER GRENOEL 

ABRAHAM LINCOLN: "WITH MALICE TOWARD NONE. W/ CHARITY FDR ALL...** 

T.S. ELIOT WROTE "THE WASTE LAND", "PRUFROCK". "THE HOLLOW MEN" 

IN GREEK MYTH, TROJAN WAR STARTS BECAUSE PARIS KIDNAPPED HELEN 

MAXIMS FROM FRANKLIN'S "POOR RICHARD'S ALMANACK" 

POEMS WRITTEN BY NATHANIEL HAWTHORNE 

"THE OLD MAN AND THE SEA": NOVEL ABOUT MAN WHO BATTLES GREAT FISH 
"WALDEN" BY HENRY DAVID THDREAU ABOUT SIMPLIFYING ONE'S LIFE 
MILTON'S "PARADISE LOST": REBELLION OF SATAN, FALL OF ADAM & EVE 
LEAVES OF GRASS BY WALT WHITMAN INCLUDES "I CELEBRATE MYSELF...." 
STEINBECK'S THE GRAPES OF WRATH. ^.^MILY MIGRATES TO CALIFORNIA 
GREEK r>LAY ANTIGONE: WOMAN DEFIES idNG TO HONOR HER DEAD BROTHER 
"TriNGS FALL APART;..." FROM YEATS' 'THE SECOND COMING" 
IN GREEK MYTH. PROMETHEUS IS CHAINED TO A ROCK FOR STEALING FIRE 
AUSTEN'S PRIDE AND PREJUDICE: THE BENNET DAUGHTERS FIND HUSBANDS 
"WUTHERING HEIGHTS": HEATHCLIFF'S OBSESSIVE LO^E OF CATHERINE 
G.B. SHAW WROTE "PYGMALION", "ARMS AND THE MAN**, AND *'SAINT JOAN'* 
IN THE BIBLE. JOB IS KNOWN FOR HIS PATIENCE DURING CUFFERING 
WALTER MITTY HAD DULL EXISTENCE BUT EXCITING FANTASY LIFE 
LANGSTON HUGHES. POET OF HARLtM RENAISSANCE. "HOLD FAST TO DREAMS'* 
GEOFFREY CHAUCER WROTE "THE CANTERBURY TALES" 
HERMAN MELVILLE WROTE "BILLY BUOD", **BENIT0 CERENO", ETC. 



ff STUDENTS 



V 1 iMIj 1 I cm 


V«UKKL v« 1 


v^UKKC 


1 7Q 




O / . O 


1 #y 


1 no 

1 U9 


cn Q 


1 7Q 


111 




1 39 


1 i ^ 


/ Z . si 


1 7ft 
1 f o 


1 J 1 


7*3 A 


1 7ft 


145 


ft 1 ^ 
O 1 . 3 


1 




fi7 Q 

o / . y 


1 65 


ft 1 

a 1 


49 . 1 


1 7Q 


ion 


fi7 n 


1 7Q 


n7 

1 O f 


/o . 3 


1 7Q 


1 fm 


C^Q *7 


1 "7Q 


1 ^'fl 


oy . J 


1 to 


Q Q 


55 . 6 


1 03 


1 d'l 


81.2 


1 65 


116 


70. 3 


1 65 


101 


61.2 


159 


98 


61.6 


179 


149 


83. 2 


179 


100 


55 . 9 


'178 


86 


48. 3 


159 


100 


62 . 9 


165 


94 


57 . 0 


165 


75 


45 . 5 


1 78 


1 1 7 


65 . 7 


159 


101 


63. 5 


165 


64 


38 . 8 


159 


76 


47 . 8 


1 59 


64 


40. 3 


178 


97 


54 . 5 


165 


76 


4u . 1 


178 


97 


54 . 5 


179 


87 


48 . 6 


178 


1 13 


63. 5 


179 


108 


60. 3 


165 


94 


57 . 0 


1 78 


60 


33 . 7 


178 


95 


53 4 


179 


103 


57. 5 


178 


99 


55.6 


178 


76 


42.7 


178 


88 


49. 4 


179 


7 1 


39. 7 


179 


72 


40.2 


179 


62 


34.6 


178 


81 


45 5 


179 


83 


46. 4 


159 


96 


60 4 


179 


82 


45.8 


179 


83 


49.7 



50 



O -H 
O -H 

r+ O 
DC 
3 3 

c m 

D. -H 
00 

■o 

Of 

(t 
o 



PROGRAM: SA$NAEP8 



AUSTIN INDEPENDENT SCHDDL DISTRICT 
DEPARTMENT DF MANAGEMENT INFORMATION 
OFFICE OF RE'JEARCH AND EVALUATION 



8.01 FRIDAY. AUGUST 19. 1988 6 
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Rank Rank 
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ITEM 


STUDENTS 








DESCRIPTION 


RECEIVING ITEM 


CORRECT 


CORRECT 


1984: DICTATORSHIP WATCHING EVERYONE TO STAMP OUT INDIVIDUALITY 


159 


76 


47 


8 


LORD OF THE FLIES: STRANDED CHILDREN TRY & FAIL TO B*" CIVILIZED 


179 


104 


58 


1 


HERMAN MELVILLE AND JOSEPH CONRAD WROTE NOVELS ABOUT THE SEA 


178 


91 


5 1 


. 1 


BIBLE: SODOM & GOMORRAH ARE DESTROYED DUE TO WICKED INHABITANTS 


165 


74 


44 


. 8 


THE SOUTH WAS SETTING FDR MANY DF WILLIAM FAULKNER'S NOVELS 


159 


54 


34 


. 0 


DANTE'S DIVINE COMEDY: JOURNEY THROUGH HELL. PURGATORY. HEAVlN 


165 


73 


44 


. 2 


RICHARD WRIGHT WROTE "NATIVE SDN" AND "BLACK BOY" 


159 


54 


34 


. 0 


D.H. LAWRENCE WROTE "ROCKING HORSE WINNER" AND "SDNS AND LOVERS" 


159 


52 


32 


, 7 


WILLA GATHER WROTE "MY ANTDNiA". "0 PIONEERS!" ETC. 


165 


42 


25 


.5 


TENNESSEE WILLIAMS WROTE STREETCAR NAMED DESIRE. GLASS MENAGERIE 


178 


102 


57 


3 


HEMINGWAY WROTE "IN ANOTHER COUNTRY", "SHORT HAPPY LIFE...", ETC. 


165 


63 


38 


2 


HARDY WROTE RETURN OF THE NATIVE. TESS DF THE 0 ' URBERVI LLES . ETC. 


159 


37 


23 


3 


CATCHER IN THE RYE: BOY DF 16 EXPELLED FROM SCHDDL. GOES TO NYC 


178 


46 


25 


8 


HENRY JAMES WROTE "DAISY MILLER" AND "PORTRAIT OF A LADY" 


179 


37 


20 


7 


IBSEN WROTE HEDDA GABLER. DOLL'S HOUSE. AN ENEMY OF THE PEOPLE 


159 


63 


39 


6 


JOSEPH CONRAD WROTE HEART DF DARKNESS. LORD JIM, SECRET SHARER 


165 


43 


26 


1 


ELLISON'S INVISIBLE MAN: YOUNG MAN FROM SOUTH MOVES TO HARLEM 


178 


55 


30 


9 


DOSTDEVSKY WROTE CRIME AND PUNISHMENT AND THE BROTHERS KARAMAZOV 


165 


51 


30 


9 


JAMCS JOYCE WROTE ULYSSES, PORTRAIT OF THE AHTIST,.., ARABY . ETC. 


179 


32 


17. 


9 


DE TDCQUEVILLE: EUROPEAN WHO WROTE "DEMOCRACY IN AMERICA" 


159 


42 


26. 


4 


EUDDRA WELTY & FLANNERY O'CONNOR KNOWN FDR STORIES SET IN SOUTH 


178 


33 


18 . 


5 


WILLUM BLAKE REFERS TO A TIGliR IN POEM "...BURNING BRIGHT..." 


159 


21 


13 


2 


BUN\AN'S PILGRIM'S PROGRESS. TEMPTATIONS THAT CHRISTIANS FACE 


178 


24 
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ATTACHMENT 9 



ITEMS TESTED ON THE U.S. HISTORY ASSESSMENT 
Weighted Percent Correct in Descending Order by National Performance 



Dtstriptian Total 

Thomas Edison invented the light bulb 95^ 

Find Soviet Union on map of Europe 92.1 

Alexander Graham Bell invented the telephone 91.1 

George Washington was president between 17tO-1800 87.9 

Find Italy on map of Europe 87.7 
The Underground Railroad was secret network to help 

staves escape 87.3 
Adolf Hitler was leader of Germany during World War 

11 87.4 
Thomas Jeffenon was main author of Declaration of 

Independence 87.4 

The assembly line was introduced by US atito industry 87^ 

Find area of 13 original sutes on map of US 84.8 

Ku Klux Klan used violence to oppose minorities 83.9 

Harriet Tubman was leader in helping slaves escape 83.8 

Find Rocky Mountains on map of US 81 J 
Guarantee of free speech and religion foimd in BUI of 

Righu 81J 
Japanese attack on Pearl Harbor led US into World War 

II 80.0 

US dropped first atomic bomb on Japan in World War II 79.9 
Washington was comnunder of American army in 

Revolution 79.2 
Churchill was prime minister of Great Britain in World 

War II 78.1 

TV became new feature in American homes after 1950 78.1 

Watergate led to resignation of Richard Nixon 77.4 

Women worked in factories during World War II 77.3 



ERIC 
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ATTACHMENT 9 
(Continued, page 2 of 8) 



ITHMS TrSTKI) ON TUF. VS. HISTORY ASSESSMI-NT fCtmdnue^) 



Dm$€ripiion 

Jamestown w*s firsi pcrmancni English colony 76.1 
Find West Germany orwrnap of Europe 76.1 
Undbergh made first lolo (light across AtUntic '6.1 
Nazi decimation of Jewish people in Europe called the 
Holocaust 

The Great Depression was a period of mass 

unemployment 
-Prohibition" refers to ban on sale and consumption oi 

liouor 

The Great Depression occurred between 1900-1950 72^ 
Vietnam War had strongest citizen protest movemenu 7^.1 
Qvil rights movement of 1960s focused on equality for 

minorities . , 

Discovery of foid in California was a cause of westward 

movement j j r 

Find area on US map that fought for independence trom 

Mexico 

Invention of cotton gin stimulated plantation economy 

in South . . 

Germany and Japan were main US enemies in World 

World War II ended between 1943-1947 70.7 

Indians were put on reservations after Civil War 70.5 
Find Mississippi River on map of US 

Find Great Britain on map of Europe '"-^ 
Most people in English colonies of North America 

worked as farmers ^ ^ 
"Secession" refers to withdrawal of Southern sutcs from 

Union 



75.S 
75.1 
74.6 



71.7 
7U 
71.0 
70.7 
70.7 



69.7 



Susan B« Anthony was a leader of wooien's sufoge 

movement 63.9 

Colu-nbua di s co v ered the New World before 1750 68.1 

Abraham Lincoln wrote the Emancipation Proclamntion 6S.0 
The Declaration of Independence was signed between 

I7SOrl80O 67.S 
The Declaration of Independence marks colonies' break 

with England 67.6 
Stamp Act of 1765 was attempt by English to tax 

colonies 67J 
US policy after World War II was to provide aid to 

Europe 67.2 

Find France on map of Europe 65.8 
US profvoked to enter World War I by German 

submarine attacks 64.6 

Watergate occurred after 1950 64.5 
Bmm deciaicn of 1954 ruled school segregation 

unconstittatbnal 63.7 
Alexander Hamilton known for urging strong national 

government 63.5 

Find area of the Confederacy on map of US 63.4 

Sputnik was the first man*miade satellite 62.7 

Pfcsjy vs. Ferguson decision approved racial segregation 61.4 

The southwestern US was explored and settled by Spain 61.0 
United Sutes Constitution was written between 

1750-1800 60.9 
East Coast of US explored and sealed mainly by 

England 60.6 
Woodrow Wilson appealed for American entry into 

Lcagtie of Nations 60.2 

Japan bombed Pearl Harbor bexwxen 1939-1943 60.0 
"Checks and balances" divides power among branches of 

federal giivemment ^ 59.9 



'aTTACHKENT 9 
(Continued, page 3 of 



ITEMS TESTtl) ON THE U.S. lUSTbRY ASStSSMKNT iCimunmd) 



Dmcr i piiom Total 

Heavy immigraiion in t970s-B0t came from SE Am &nd 

Laim America 59.5 
Articles of Ccnfedcrviion were first Coiuitiuiion during 

Revolution 59.4 

r.eprcientative government existed in Colonies 5S.0 

John D. Rockefeller formed Standard Oil 57.8 
US foreign policy after World War II was containment 

of Commirntsm 57.7 

World War 11 was between 1900-1950 57 J 
Booker T. Washington was major black leader before 

World War 1 57.1 

Find area of map of US purchased from France 57.1 

"Prohibition" occumd between 1900-1950 56.4 
B^ore 1800 most immigrants came from northern and 

westam Europe 56.3 

Eisenhower was president h^ftween 194^1963 55.6 

Israel has never been invac^J by Soviet Union 55.4 
Japanese^Amcricans were forced into camps during 

World War U 55.2 
Nixon esttblishcd relations with the People*s Republic of 

China 55.1 
A cause of population movement in 1800s was 

reasoiuble land prices 54.7 
Sodal Security «ystem was mtroduced during the New 

Deal 54.7 
US gave military support to South Korea with United 

Nations 53.9 

Dust Bowl of 1930s fostered movement to California 53.8 

Amendment of 1920 granted women right to vote 53.7 

Stalin was leader of Soviet Union during World War II 53.6 



FopuUit Party advocate government support for 

farmers 52.8 
New Deal identified with changes in social, ectmomic 

policies 52.3 

Franklin Roosevelt was president between 192^1946 52.0 

Before Civil War, nation debated spread of slavery 51.6 

"Give me liberty or give me death^-^Patrick Henry 51.1 
TaisscZ'faire'* means miitimai goverrinent regulation of 

economy 51.0 
Monroa Doctrine said Etirope shjuld not gnin land in 

western hemisphere 50.9 
Washington's Farewell Address warned against foreign 

alliances 50.3 

Canada and Mississippi valley first wxpbred by France 50.3 

Samuel Compers was first president of AFL 49.8 
Mania Lutbcr King. Jr^ rose to prominence in 

Montfomery bus boycott 48.9 

US dropped fim atomic bomb between 1943-1947 48.6 

Valley Fdrge was lowest i^int in Revolutionary War 47.9 
Women's right to vote was not guaranteed after Civil 

War 47.3 
An issue in War of 1812 was Great Britain's interference 

writh shipping 47.0 
Andrew Carnegie was associated with development of 

steel Industry 46.9 

Thomas Jefferson was president between 1800*1820 45.6 
^ ^ The Constitution divides powers between states and 

j J federal government 43.8 
Missouri Compromise admitted Maine as free. Missouri 

as slave state 43.0 

Woodrow WilMin was y Jdcm between 1912-1929 42.9 
Senator Joseph McCanhy involved in controversy about 

Commiiniiii* 42.6 
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ITEMS TESTED ON THE U.S. HISTORY ASSESSMENT (continued) 



Dexription Totai 

''Nullirication* related to siaies* rifhu 42.4 
Hoover. Franklin Roosevelt were •residents during 

Depression 41.1 

Jane Addams founded settlement houses to help the poor 41.0 

''Reconstruction* occurred between I8SO-1900 40.2 

Ttm F^dtrmlist advocated adoption of Constitution 40.1 
XW Scorr decision: slave who moved to free sute was 

notfre* * 39,5 

D-Day occurred between 194>*1947 39.5 
Renaissanr* was characterized by cultural, technolopcal 

advances 39.3 

Paine's Common Smm argues for colonial independence 38.3 

EmaodpaUon Proclamation freed slaves in Confederacy 38^ 
Union membership grew in the 1930s because of new 

3a^ 

Jamestown founded before 1750 38.0 

Restrictions en Immigration were not part of New Deal 37.8 
Three-fifths compromise* in Constitution defined sutus 

of slaves 37,7 
Immigration from southern and eastern Europe grew. 

1890-1910 37.6 
Immigration restriction in 1921. 1924 aimed at S£ 

Europeans 37J 

Scopes trial was about teaching evolution 37 J 
Upton Sinclair. Lincoln Steffens, Ida Tarbell known as 

rauckrakers 37.1 

Theodore Roosevelt was president between 1895-1912 36.9 
Articles of Confederation failed to provide adequate 

using power 35.8 



Find region on US map acquired from Mexico in war 36 J 
Religious toleration in colonies due to common interest 

of many groups ^^-^ 

Jonu Salk invented polio vaccine 343 

Spanisb^Unerican War made US an international power 33.0 
American foreign policy after World War I known as 

isolationist ^^-^ 

The Civil War occurred between 1850-1900 32^ 
US foreign poUcy in early 1900s: "Speak softly, carry a 

big stkk' 31.6 
Puipoee of Jim Crow laws was to enforce racial 

segregation 

Magna Carta is foundation o! British parliamentary 

system 30.6 

Andrew Jackson was president between 1820-1840 29.9 

Reformation led to establishment of Protestant sects :9.8 

The United Natioas was founded beMfsen 1943-1947 2S.9 

The Seneca Falls Dsdaratioa c o nc er n e d women's righu 2S.8 

Abraham Lincoln was president between 1860-1880 24.7 
Lyndon Johnson's term Included Medicare and Voting 

Rights Act 23.9 
E^ty Friedan and Gloria Steinem led women*s 

movement in 1970s 22.8 
"Rrop^ve mo vement* refers to reforms before ^.'orld 

War I 22.6 
^^Reconstruction" ref ^ to readmission of Confederate 

states 21.4 
John Wlnthrop and the hiriians fourded a colony in ^ R 

Boston 19*^ 




Neir Tlie ditcripiiaas abe«« aie psraphraMS of iht Infermation tcMd. The sntwcrt art not idenikal lo iht material on the ie>t. In leme 
l-r fealawel space, the iiJurma^ iacwapkif ss prmaied hm. Wherem s btoc of time it m the smwct si-dcni* >-crf pmcmcU 
1 1 limitl i iil isiii t i n l inss rtr- ' ''' t^^^^ — riaik. mmi tmu tvcn ihiwtcf 
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ITEMS TFSTUD ON THE LITERATURE ASSFSSMENT 
Weifhicd Ferccni Cormt in Dcircnding Order by Naiionai Performance 



Description Totai 

In Dibk. Noah (athered pairs of creatures into ark 94.0 
In Bible, Moses got 10 commandments, led his people 

from Egypt 92.^ 

Romeo and Juliet hindered by feuding families 89.7 

Martin Luther King, Jr.: '*I have a dream . . .** 88. t 

Hamleu To be or not to be . . .** (S lines) 87.3 
Ebeneaer Scrooge was stingy character in '*A Christmas 

Carol- 87.2 

In Greek mythology, ruler of gods Is Ztfus 86.7 
White Rabbit. March Hare, etc^ art in Aiie^'s Adymtuns 

in WcmMoFfd 86.1 
Robin Hood is known for stealing from rich to give to 

poor 85.7 

Cinderella's rags turned into gown and she met prince 85.1 
Robinson Crusoe was shipwrecked on an island and 

survival 83.6 
The Lord is my shepherd ..." (3 lines) is from Psalm 

23 • 82.4 

The magician who advised King Arthur was Merlin 80.5 
Advtntum of Huekkbtrfy Fxnn^ is about orphan boy and 

runaway slave 80.5 

In Bible, Book of Genesis iicludes account of creation 79.5 

Plato and Aristotle are best known as philosophers 79.0 
Victoiy of unknown team parallela Bible story of David 

and Goliath 78.0 
"Rip van Winkle" is about man who slept for 20 years 

and awoke 76 J 
E. A. Poe wrote "Pit and Pendulum," Tall of House cf 

tJshcr." etc 75.2 



Triends, Romans* coimtrymen ..." is from Mita 

Caoar 74.9 
Juliet said. "What's in a name? That which we call a rose 

74 J 

Gettysburg Address: "Four score and seven years ago our 

fathers . • . ." etc. 73.9 
Mary Shelley's novel Fmrdcmtmn is about scientist who 

created creature he could not control 73.8 
Novel that helped the antislavery movement was Vnek 

Tom's Cabin 73.4 
Epic about a Greek war lead^'s voysce home is the 

Odymy 73.0 
Oliver. Micawber. Pip. and Gradgrind appear in novels 

of Dickens 72.7 

Ludfer is anolhtr name for Satan 72J 
Legendary King Arthur presided over kaighu of Rour';f 

Table 72.0 

In Bible, Samson is known for great strength 71.8 

Jesus was betrayed for 30 pieces of silver by Judjs 69.5 
Emily Dickinson was American poet who liv<:Q m 

solitude, wrote often about death (lines fron 2 poems) 69.3 
Moral of tortoise and hare: slow and sttsdy wins the 

race 67.7 

In Cain and Abel story. Jealous young man kills brother 67.3 
Sherlock Holmes is main character in Ho$md of thm 

P'" *y Bnskmvitks. etc. 67.2 
* ' ' Edgar Albn Poe wrote poems "Annabel Lee" snd 

"Raven" 67.0 

In Roman mythology, Venus is gcdHm of 'ove 66.5 
Y2rn^' ^ self-evident, that all men are 
. h I\lv created equal . . . ." etc., is in the Declaration of 

■ "'^ i ji n ii ffli i ffTirrmii i i i i Indepcfidcncc 65.7 
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ITEMS TESTED ON Tilt- LITERATURE ASSESSMENT (C.mur,utdt 



DeBcriptiom 



Toiai 



-W€, the people of the United States, in order to form a 
more perfect union." is from the Preamble to the 
ConsiituUon 

Way by Thornton Wilder about typical New England 

vilUfc is Our Town 
Aesop is best known for writing fables 
In Creek myihology, multitude of evils escaped from 

Pandora's box 
Hemingway wrote U^Ikmh <^ Scff ro/Zs, JhtSun 

Also RiM&$ ^^"^ 

Jack London wrote Coil of tk€ Wild about dog in Yukon 62 J 
Robert Frost wrote poems TBut I have promises to keep 

. . , Two roads diverted in a wood . . H 62.5 
In Melville's MotrOieK Captain Ahab's obsession is 

UUiput, country of little people, is part of GalUver's 
Trmmis 

77^ /2aJ fl^dtgc o/ Cocirme is about young soldier s 

struggle to overoome his fear in Civil War 61.6 
In Greek mythology. Atlas has to support heavens on his 

shoulders ^^*^ 
In Bible, King Solomon is famous for his wisdom 61,0 
The Iliad is an epic poem by Homer 60,6 
In bibUcal stOf7, Jonah is swallowed by big fish 60^ 
la Mark Twain novd. Tom Sawyer is known for clever 

ways of avoiding vmk^ trouble 
Midas was mythical king whose touch turned ol^ects to 

gold 59,5 
Thm Scarlet Lutor is novel about woman who was 

unfaithful '^'^ 




To Kin a Mockifiibird is novel about 2 children affected 

by comnranity conflict when father defends black man 59,1 
Dickens's novel Tak of Two Citm occurs during French 

Revolution 59.0 
LongTsUow wrote poem about Paul Revere that Includes 

-One if by land. / Two if by sea" 58,8 
Franklin Roosevelt satd. Tlie only thing we have to fear 
is fear ItseiT and "Yesterday. December 7, 1941,-« 
date whkh wiU live in Infamy , . 572 
In addittoii to plays» Shakespeare also wrote lonneta 57,0 
Young man who wanes fbrnme. eomei to his senses is 

like pro^gal son 56.5 
In Roman mytlwlogy. Mars is god of war 56^ 
WinsM CbufciiiU s^ 1 have nothing to offer, but 
blood, toil leofi. and sweat" and "From Stettin in tlie 
Baltic to TMeM in the Adriatic an Iron Curtain has 
issrs wlnil across the continent" 55.7 
Arthur Millar wrote 71m CrnciMf and i>Htf A o/ 

Solmmm 53.7 
A Raisin in tho San is about e x perience s of bl^ck family 53,2 
John F. Kennedy: "And so, my fellow Americans, ask not 
what your countiy can do for you; ask what you can 
do for your country* 52*7 
In Greek mythoiogy, Jason traveled in quest of the 

Ckilden Fleece 52.5 
7^ Crmt Gauhy is novel by F. Scott Fitzgerald about 

pursuit of weahh and status in 1920s 51.7 
Character in ancient Creek play who unknowingly killed 

father and married hia mother is Oedipia 51.7 
"AchilW ^^eeT means weak point in strong person 51.5 
In CfCfS; myt hology ^ aaoislus and Icinie make ^raa 
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ITEMS THSTED ON TUB LITHRATURE ASSESSMENT (Conimueti) 



Description Tot^l 

• 

Odysbcus is mythical Creek hero who journeys home 

after Trojan War 49.8 
Byron. Keats, and Wordsworth are chiefly known as 

poets 48.1 
Shakespeare*! play Juliiu Catsar is about the fate of his 

assassins 48.0 
Don QuiMte was Spik.ii«h knight who attacked 

windmills, thinking they were giants 47.9 
Macbeth is play about man whc«e ambition to be king 

led him to murder 47.3 
To every thing there is a season, and time to every 
purpose under the heaven: a time to be bom. and a 

time to die": the Bible 46.7 

In Atowu//, the hero battles with the monster Grendei 45.8 
Abraham Lincoln: "With malice toward none, with 

charity for all . * 45.7 
T. S. Eliot wrote 77m WcuU Land The Love Song of J. 

Alfred Prufrock." and The Hollow Men" 4S.4 
In Greek mythology, Trojan War starts because Paris 

kidnapped Helen 4S.4 
"A penny saved is a penny earned** and "A small leak 
will ssiik a great ship" are maxims from Franklin's 

Poor Richard's Aimaitaek 43.6 
The Minister's Black Ve?!/ Toung Goodman Brown." 
'TUppacdni's Daughter** were wrinen by Nathaniel 

Hawthorne 43.3 
77ie Oid Man and tha Sea is novel about man who 

battles great fish 43.0 
Waldan by Henry E>avid Thoreau is about simplifying 

one's life 42.9 

John Milton's Paradise Lost is abotu rebellion of Satan, 

fall of Adam and Eve 41.2 
Walt Whitman wrote Leaves 0/ Crass, which includes 

line, 1 celebrate myself, and sing myself 40.2 
Steinbeck's 77te Grapes of Wrath is about family that 

migrates from Dust Bowl to California 39.7 
Antigone is Greek play about woman who defies king to 

honor her dead brother 39j 
Things fall a|»rt:/The center cannot hold * . * " etc.. is 

from The Second Coming" by William Butler Yeau 38.9 
In Greek mythology, Prometheus is chained to a rock 

for stealing fire 31^ 
In Jane Aas(ten*% Pride and Prefydiee, theBennct 

daughters find husbands 
Wlith^ing HeigfM is about Heathdirs obsessive bve of 
Catherine 

George Bernard Shaw %vrote Pj^naiion. Arms and the 

Maru and Saint Joan 37,5 
In the Bible, Job is known for his patience during 

suffering 37 2 

Walter Mitty had dull existence but exciting fantasy life 36.6 
Langston Hughes was poet of Harlem Renaissance who 
; ^ wrote *Hold fast to dreams." etc. 

Geoffrey Chaucer %vrote The Canterbury Tales 
Herman Melville wrote BiUy Budd. "Benito Cereno." and 

•^rtleby the Scrivener" 35.9 
i9$4 is novel about dieutorship that %mches everyone 

to sump out individuality 35 5 
Aor^ of the fties is novel about children stranded on 

island who try and fail to lead civilised life 35.3 
I C D I Herman MeMlle and Joseph Conrad are authors of 
CI\1\> noveK about the tea 



38.0 
37.9 



36.2 
36.1 



geSO 



34.7 
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ITEMS TIISTED ON THE LITV.RATURE ASSESSMENT {Contmued} 



Description Total 

In ihc Dibic, the cities of Sodrm and Gomorrah are 

destroyed because of wicked inhabiunts 33.4 
The South wos scttinf for many of William Faulkner's 

novels 33.3 
Dante's Divine Comedy is about journey through Hell, 

Purgatory, Heaven 32.8 
Richard Wright wrote Native Son (about black life in 

Chicafo) and Biack Boy 32.3 
D. H. Lawrence is English author who wrote The 

Rocking Horse Winner* and Sons and Lovers 28.7 
Willa Gather wrote about lettling of West in My Antonio, 

O Pioneers/, and Death Coma for the Archbishop 28.2 
Tennessee Williams wrote A Streetcar Nomad Dasirt and 

Tha Class Menagerie 27.6 
Ernest Hemingway wrote In Another Country," The 

Short Happy Life of Francis Macomber^ and The 

Killers* 27.3 
Thomas Hardy wroU The Return of the Native, Tess of 

the DVrberviiles, The Mayor of Casterbridis 24.4 
Catcher in the Rye is novel about 16-year-old boy who is 

expelled from school, goes to NYC for wrxkend 22.5 
Henry lames wrote about American/European life in 

Daisy MiUer and Portrait of a Lady 21.9 
Henrik Ibsen wrote Hedda Gabier, A DolVs Hottse, An 

Enemy of the People 20.3 
Joseph Conrad wrote The Heart of Darkness, Lord Jim, 

and The Secret Sharer 19 J 
Ralph Ellison's Invisibie Man is about young man who 

grows up in South, moves to Harlem 18.3 



Dostoevsky wrote Oimt and Punishment and The 

Brothers Karamazov 17.1 
James Joyce is Irish author who wrote Utyssss, A Portrait 

of the Artist As a Young Man, "Araby^ and 'Eveline" 15.6 
Oe Tocqueville was European who traveled in US and 

wrote Democracy in America 15.5 
Eudora Wdty and Flannery O'Connor are known for 

stories set in South 14.4 
William Blake refers to a tiger in poem. "—I —I 

burning bright/ In the foresu of the night,/Mfhat 

i mmortal hand or eye / Cotild frame t hy fearful 

symmetry?" 13.6 
John Bunyan's novd PUgrim^s Progress is about the 

temptations that Christians face in life 13.4 



Notr Thcte dcmiptiont are paraphraies of the ir^ormaiion (esied. In most instanm, for reasons of space, (he informaiion it an abbrr ated 
and sometimes incompieta version of (he item on (he assessment. 
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ATTACHMENT 10 



Jxine 1, 1988 



Name/Titld 

Position 

Affiliation 

Dear 

I would lika to request that you serve in the capacity of 
reviewer for the Austin Independent School District's Content 
in the Curriculvm project. 

The Content in the Curriculum project evolved in response to 
the growina national concern that students nay lack basic 
knowledge in U.S. history and literature. In the spring of 
1986, the National Assessment of Educational Progress (NAEP) 
tested a nationally representative sample of 17--year-olds to 
assess their basic knowledge of U.S. history and literature. 
The results of this assessment were published in a best- 
selling book by Diane Ravitch and Chester Finn entitled What 
Do Our 17""Year-01ds Know? 

In Also/ we are likewise interested in what our students 
know, but we are also concerned with several other 
fundamental questions: (1) What is important for us to teach 
our children? (2) Are these important things m our 
curriculim? and (3) Are we teaching these important things to 
our children? 

In order to address the second and third questions, it is 
necessary to obtain some guidsmce amd direction in regard to 
the first question. To do this, we are asking persons with a 
stake in humanities instruction to review the NAEP item 

S ecifications ^ad to rate them as to their importance for 
sp students . TJEe'Ttem specifications for either U.S. 
history or literature, along with additional information and 
instructions lor rating, are enclosed. 

Your assistance as a reviewer will help ensure that AISD's 
U.S. history and literature curricula contain the content our 
yoiing people need to know to participate fully in our complex 
modem society. If you are unable to take on this task, 
please get in touch with David Wilkinson at 458-1227. I 
hope, however, that you will be able to assist the Austin 
schools by serving as a reviewer. 

Sincerely, 



' t John Ellis 

Superintendent of Schools 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
Department of Management Information 
Office of Research and Evaluation 

CONTENT IN THE CURRICULUM 

Review of NAEP Item Specifications 



BACKGROUND INFORMATION 

In 1986, 7,812 17-yeaj:-old students across the nation were 
tested on their Icnowledge of U.S. history and literature. 
Conducted by the National Assessment of Educational Progress 
(NAEP), one of the nation's leading testing agencies, the 
test was the first of Its kind. The students were drawn from 
public and private schools, and the sample was representative 
of different ethnicities, both sexes, and all regions of the 
United States. 

Although the test was Intended to be a measure of basic 
knowledoe In the two areas, students could correctly answer 
only 55% of the history questions and"32T "of the liierature 
questions . 

Diane Ravltch and Chester E. Finn, Jr., authors of the best- 
selling book What Do Our 17«Year»01ds Know? ^ which presents 
the results of the assessment, have characterized these 
results as '^a shameful level of performance.** 

In the Austin Independent School District, the Implications 
of the national results dovetail with a local concern with 
the amount of content being taught and the balamce between 
skills and knowledge In the curriculum. The Superintendent 
and his cabinet have raised the question, ''How does AISD 
determine what the content of Instruction ought to be?" To 
begin to auiswer this cpiestlon, the Office of Research and 
Evaluation has undertaken an evaluation of the content In 
American history and literature. 

One key feature of this evaluation centers around the 
question, "What are the Important things that we should teach 
our children?" Taking as a starting point the domain of 
content defined by the National Assessments a group of 
persons with a s^ke HTn insT:ructlon in AISD Tteachers, 
Instructlonal'^coordlnaEors , sub j ect area professors from 
Austin universities, etc.) Is being asked to review the NAEP 
item specifications and rate tnem as to their importance for 
AISD students ^ 

These ratings will serve to inform the remainder of the 
evaluation. Phase two of the evaluation centers arovind the 
question, "Are the important things in our curriculum?" 
A review will be conducted of the Texas essential elements, 
the scope and sequence of textbooks, a:nd AISD course outlines 
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for •vld#nca that the Important content is Included In the 
curriculum. Phase three Involves an analysis of teachers' 
tests under the assumption that teachers test what is taught. 
The final phase of the evaluation would be testing AISD 
eleventh graders so that AISD's perform2uice could be compared 
with the performance of students nationwide. 



INSTRUCTIONS FOR RATINQ 

Yov will be rating the objectives and subobjectlves of one of 
the areas of the NAEP history and literature assessment, 
either history or literature. The NAEP learning objectives 
were created by two national committees, one for history and 
one for literature. The objectives were the basis for the 
121 literature and 141 history items administered in the 
assessment. The objectives represent the consensus each 
committee arrived at about what should be tested. However, 
we are interested in what you think is important that AISD 
students be tauqEt . 

In the blank to the left of each objective or subobjective, 
write the number corresponding to the rating you select, 
according to the following scale. 



Somewhat 

Essential Important Important Unimportant 
1 2 3 4 



Please feel frde to write comments about the basis for your 
ratings . 

If there are other areas not addressed by the objectives 
which you think are important for students to know, please 
list them at the end. Write on the backs of the sheets with 
the objectives or attach additional pages. 

When you have completed your rating, please use the enclosed 
stamped, self -addressed envelope to return the sheets to: 

David Wilkinson/ORE 
6100 Guadalupe 
Austin, TX 78752 

Please return your ratings by June 10, 1988 . 

If you have any questions about the rating task or about the 
evaluation, please call David Wilkinson at 458-1227. 



THANK YOU VERY MUCH FOR YOUR TIME AND YOUR HIILP. 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
Department of Management Information 
Office of Research and Evaluation 



THE NAEP LEARNING OBJECTIVES 



HISTORY 



Exploration and Colonization: up to 1763 



A. Exploration 

1. Factors contributing to exploration (e.g., desire for 
wealth, technological advances) 

2. Major countries and explorers Involved (e.g., Spain,- 
France, England) 

B. Colonization 

1. Factors contributing to colonization (e.g., religious, 
economic, and social Issues) 

2. The first colH)n1es (e.g., governments based on English 
models, leaders of originel colonies, and relations with 
Native American cultures) 

3. Aspects of colonial life (e.g., diversity of religious 
and ethnic groups, origins of slavery, types of economy, 
and immigration) 

II. The Revolutionary War and the New Republic: 1763-1815 



A. The Revolutionary War 

1. Factors contributing to the Revolutionary War (e.g., 
English exploitation of the colonies and emergence of an 
American Society) 

2. Documents (e.g., Declaration of Independence, the 
Articles of Confederation, and Common Sense) 

3. Importance of American leadership (e.g., George Washing- 
ton, Thomas Paine, John Adams, Thomas Jefferson, Benja- 
min Franklin) 

4. Events and aspects of the war (e.g., political parties^ 
leaders) 

B. Establishing the new nation 

1. The Constitution (e.g., major compromises, structure, 
and steps leading to ratification) 

2. Forming the new government (e.g., political parties, 
leaders) 

3. Expansion (e.g., mig'-ation, the Louis-'ana Purchase, 
trade with Europe, difficulties maintaining neutrality, 
and the War of 1812) 



ERIC 
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III. Nationhood, Sectionalism, and the Civil War: 1815-1877 

A. Economic and social change (e.g., growth of cities, 
1 nciustrl al 1 zati on , transporta ti on ) 

B. Jacksonlan democracy (e.g., political parties, expanding 
the franchise 9 treatment of Native Americans) 

C. Expansion of slavery (e.g., Missouri Compromise, planta- 
tion econoiqy, and abolitionists) 

D. The Civil War 

1. Federal powers versus states' rights (e.g., nullifi- 
cation) 

2. Factors leading up the the Civil War (e.g., slavery, 
economic differences between North and South, and 
secession versus preservation of the Union) 

3. Abraham Lincoln (e.g.. Emancipation Proclamation, 
Getty sberg Address) 

4. Effects of the Civil War (e.g., growth of North; des- 
truction of South; Reconstruction; passage of Thirteenth 
Fourteenth, and Fifteenth Amendments— abolition of 
slavery, due process and equal protection, and the 
right to vote) 

IV. Territorial Expansion, the Rise of Modern America, and World 
War I: 1877-1920 

A. Territorial expansion 

1. Western expansion (e.g., territories Involved, improved 
transportation, farm protests, Indian Wars, and the 
reservation system) 

2. The Spanlsh-Aiuerlcan War (e.g., territorial acquisi- 
tion. United States becomes world power) 

B. The rise of modern America 

1. Dig business (e.g., leaders, new production techniques, 
and monopolies) 

2. Labor unions (e.g., working conditions, American 
Federation of Labor, problems In organizing unions) 

3. Progr^islve Era and reform legislation (e.g., pop- 
ulism, Theodore Roosevelt, muckraking, ''trust bust- 
ing," and conservation) 

4. Immigration (e.g., shift In patterns, efforts to re- 
strict—National Origins Act) 

5. Segreg<it1on and failure to achieve equality for blacks 
(e.g., Plessy v. Ferguson— separate but equal, Jim Crow 
laws, NAACP) 
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C. The First World War 

1. Reasons for United States entry (e.g., rights of neu- 
trality and submarine warfare) 

2. Characteristics of the war (e.g., countries involved, 
leaders— Woodrow Wilson) 

3. Events and effects (Treaty of Versailles, League of 
Nations, substantial American contribution. Isola- 
tions mood after war) 

0. Women's vote— Nineteenth Amendment (e.g., early advocates- 
Susan B. Anthony, Elizabeth Cady Stanton, Seneca Falls 
Convention) 

The Great Depression, the New Deal, and World War II: 1920- 
1945 

A. The 1920's (e.g., temperance movement and prohibition, 
inventions. Scopes trial) 

B. Causes and characteristics of the Great Depression (e.g., 
stock market crash, collapse of economy. Dust Bowl) 

C. Franklin D. Roosevelt and the New Deal (e.g., changes in 
role of government, gains for labor, agricultural price 
supports. Social Security) 

D. World War II 

1. Factors leading up to United States involvement In the 
war (e.g., rise of totalitarianism. United States 
initially neutral, entry after Japanese attack on 
Pearl Harbor) 

2. Characteristics of the war (e.g., global nature with 
European and Pacific theaters; the Holocaust; leaders- 
Churchill, Stalin, Hitler, and Roosevelt; effect of war 
on roles of women and minorities; Japanese relocation 
camps; relationships with All ies— Yalta) 

3. End of the Second World Was (e.g., Roosevelt dies and 
is succeeded by Truman; United States uses atomic bomb 
to end war with Japan) 

4. The United Nations (e.g., purpose) 

Post-World War II: 1945 to Present 

A. The Cold War (e.g., containment of communism, beginnings of 
arms race, Truman Doctrine, Marshall Plan, NATO, 
McCarthyism, communist expansion in Europe) 

B. Korean conflict (e.g., U.N. *orces, MacArthur versus Truman) 



Page 57 



ATTACHMENT 12 
(Continued, page 4 of 4) 



C. Postwar prosperity (e.g., demand for consumer goods; the 
baby boom; the growth of suburbs; Inventions and dis- 
coveries; Sputnik begins space race) 

0. The 1960 's 

1. President Kennedy and the New Frontier (e.g., space 
program, Cuban missle crisis. Peace Corps, assas- 
sination) 

2. President Lyndon Johnson and the Great Society 
(e.g.. Increased social legislation and government 
spending) 

3. Civil rights movement (e.g.. Brown v. Board of 
Education and beyond, Martin Luther King, Jr., 
civil rights legislation) 

4. Vietnam (e.g., growing unpopularity of war, protest 
movement) 

E. The 1970' s 

1. Opening to China 

2. United States withdrawal from Vietnam 

3. Watergate, resignation of President Nixon, succession 
of President Ford 

4. Women's Rights Movement (e.g., Betty Friedan, Gloria 
S'telnem, and ERA) 

5. Energy crisis 

6. Human rights 



Other Important Areas ; 

If there are other things you think are Important for students to know, please 
list them here. Use the back of the sheet or attach additional pages If 
necessary. 



(A blank page included for the reviewer's comments has been omitted here in the 
interest of cost. ) 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
Department of Management Information 
Office of Res&drch and Evaluation 

THE NAEP LEARNING OBJECTIVES 



LITERATURE 



I. Novels, Short Stories, and Plays 

These words and their authors are significant .because of 
universal characters, plots, and themes. This universality 
arises when a work portrays an experience or a characteristic 
comnon to humanity and so iielps us to understand ourselves 
and to develop our personal values. 

A. Kovel s 

The emphasis is on American authors and their works 
(Twain's The Adventures of Huckleberry Finn , Gather's 
My Anton iT n riajor English and foreign (transl ated ) 
woncs are also included ( Robinson Crusoe , 1984 , Don 
Quixote ). Knowledge and understanding of cEaracWs, 
plots, and themes are essential. 

B. Short stories 

Most of the stories are by American authors (Edgar Allen 
Poe, 0. Henry, Shirley Jackson). A knowledge of char- 
acters (Walter Mitty) and plots ("Rip Van Winkle") will 
be assessed. 

C. Plays 

The emphasis is equally divided between Shakespearean 
plays ( Romeo and Juliet . Hamlet) and classical and 
modern pi ays ( ueqipus RexTTurn'own , A Raisin in the 
Sun ) . Knowl edge or characters, plots, and rami liar 
passages will be assessed as well as an understanding 
of themes. 

II. Myths, Epics, and Biblical Characters and Stories 

Knowledge of these Is necessary in order to understand 
other literature in cur culture because of the frequency of 
allusions and references to these texts. This knowledge 
constitutes a cultural shorthand that enables students to 
recognize certain universal characters, symbols, and themes. 
With this knowledge, students may recognize the similarities of 
human experience, past and present. 
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A. Myths, heroes, and legends 

Classical Greek and Roman mythology (Midas, Venus, Zeus) 
Is the ma.tor emphasis In this area. Also Included are 
the Arthurian legend (Merlin), fairy tales (Cinderella), 
folk heros (Robin Hood), and fables ("The Tortoise and 
the Hare"). 

6. Epics 

Included are the earliest epics ( The Odyssey ) and whose 
that came later ( Paradise Lost ). 

C. Biblical characters and stories 

Major biblical figures (Moses, Judas), events (the Flood), 
and parables (the Prodi ga*! Son) are the core of this area. 

III. Poetry 

These poets and works are significant because of themes, 
allusions, and Imagery that enable us to understand the 
meaning of our human experience, that help alter our 
sensibilities, and that enlarge our Imagination. Some 
of these works are also frequently quoted and thus have 
become vehicles for communication with others. 

Included are mostly American poets and their pjems 
(Dickinson, Whitman, Hughes) as well as some English 
poets (Shelley, Blake). Some familiar passages (from 
Frost's '•Stopping by Woods on a Snowy Evening") are 
als^ cited. 



IV. Nonflctlon 

Some of these works and their authors are frequently 
referred to because they have come to embody the values 
of our culture. Others are worthy of study because 
of their success In the comnunlcatlon of Ideas by the 
use of effective rhetoric. 

A variety of American nonflctlon has been Incluuad: 
speeches (King's "I have a dream"), historical documents 
(Ciclaratlon of Independence), and autobiographies 
(Thoreau's Walden). 



Other Important Areas: 



If there are other things you think are "^niportant for students to know, please 
list them here. Use the back of the sheet or attach additional pages if 
necessary. 



(A blank page included for the reviewer's commer.ls has been omitted here in 
the interest of cost, ) 
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ATTACHMENT 14 
TTEMS V?ITH MORE THAN FIVE ANSWER CHOICES 



TO THE TEACHER: 

Oopsl The answer sheet we are using has spaces for only five answer choices, 
but some history qpiestions have six answer choices. The test forms and the 
item numbers wnich have six answer choices are: 



Test 
History 
History 



Form 
2 
4 



Item numbers 
39-41 
17-23 



Please instruct students as follows: 



ON FORM 2. ON ITEMS 39-41 



ON FORM* 4, ON ITEMS 17-20 



Use the **A** bubbles next to 
items 69-71 as the "F" answer 
choice. 



Mark an "F- answer choice in the blank 
space to the right of the line with the 
items. Line up the mark with the column 
of "A" bubble below. 



ON FORM ON ITEMS 21-23 

. Use the "A" bxibbles next to items 51-53 
as the "F" answer choice. 

The ex2unples below illustrate how students should mark the answer sheet. 
CUT SHEETS PROVIDED INTO HALVES AND GIVE EACH STUDENT A COPY. 



FORM 
4 



^ ONLY ^<^<^ 



^ FORM 
_ ONLY 



It d) CD 
<• CD CD 



(T^ 

O CD CD 



^ Ex.: 

ICDCD 



21 O CD 

22 O CD 

23 CD CD 



O 
O CD CD 
CD O CD 



24 O CD 

29 O CD 
2« O CD 
27 O CD 
2f O CD 
20 O CD 

30 O CD 



O CD CD 
O CD CD 
O <D CD 
O OCD 
O O O 
O O O 
O O O 



31 O O 

32 CD O 

33 O O 

34 O O 
33 O O 
38 O O 

37 O O 

38 O O 



o o o 

GD O 

O O O 
O O O 

o o o 
o o o 
o o o 



38 O O 

40 O O 



o o 

CD O O 



oo 

^ A 



CD CD y 



If "F" Is the inswr choice for Item 17. 

O O (D (D O QD ® (T 300®000000 



iubble ^sre. 

o o o o o ol 



^ Ex.: If **F" is the answer choice for Item 21, bubble here. 



9t 

92 O: 
mOICD O O 
94 O O O O 
99 O O O O 

98 O O O O 

}7 o o o o 

58 O O O O 

98 O O O O 

80 O O ^ O 



81 O CJ o o 

82 O O O CD 

S3 O O CI 

94 o o o o 

85 ^3 ^ CD 

88 O O O O 

8. o o o o 

88 'D O O O 



•30 O O Cu o 
•40 o o o o 
isO O O O O 
MO O O (D O 
«7 ^ CD O O CD 
O O O O CD 
MO O O O O 
80 D Ci^ O O O 


00000000 
36666666 
0600 0600 
6000 0000 
6666 6666 


eeaeeeee 
ooeoooeo 

00000000 

eeeeeeee 

eetieeeee 

5J5S5SS8 


t730 o o o o 
174 0 o o o o 
I750 o o o o 
1 78 O O O O ^3 
i7'0 o o o o 
1 78 o o o o o 

1730 O O O O H 
■80OOOOO 1 


8< o o o o o 
02 o o o o o 

033 CD O O ^ 
94 O C^ O O ^ 
^O O O O 
■^o O O O ^ 
< 70 O OO CD 
-•O O O O O 


t2tO o o o o 
I220 o o o o 
t230 o o o o 
I240 o o o o 
290 o o o o 
i2eO O O O O 
1270 o o o o 
i2^0 o o o o 


S5SSSBSS 

88088888 
66666666 
eOOOGOOO 
08000660 
06666666 


18100000 s 

18200000 t 
1830000 0 0 

I840 0000 H 

issOOOOO Y 

i860 0000 

te7 0 0 0 0 0 
i8aO 0000 
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Ex.: If "F" Is the ansi^r ...tolce for Item 39, bubble here. 



mOJO O O O jtoiO O 00 O |i3iO O O O 0 1 181 O^D O CD fn l^.^rn m n m 



All of the literciture tests ^ and the other two history tests , have no items 
with more than five answer choices. 

We are sorry for the inconvenience. An alert teacher caught this problem 
after testing began. 



We are sorry for the inconvenience, 
,^^^.}roblea after testing began. 



An alert teacher caught this 
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